View Issue Details

IDProjectCategoryView StatusLast Update
0000216WackoWikiunicodepublic2019-10-14 10:48
ReporterTann San Assigned Toadministrator  
PriorityhighSeverityfeatureReproducibilityhave not tried
Status resolvedResolutionfixed 
Product Version5.0.0 
Target Version6.0.xFixed in Version6.0.beta1 
Summary0000216: UTF8 support
DescriptionSQL and HTML

There is alot more to making the wiki fully UTF8 compatible:

They state that they use the PHP mbstring extension for multibyte character handling, if the system does not detect that then it falls back on their own multibyte character handling class. We'd have to write our own version of that or find an opensource one we could use. To date I've never had a host with mbstring enabled.

We would also have to add to the SQL updater code to triple the fields lengths in MySQL 4 and earlier databases.
Steps To ReproduceSteps:
converted all PHP files to UTF-8 – DONE
set utf-8 as default encoding – DONE
removed do_unicode_entities() calls – DONE
remove all supertag usage – DONE
drop support for MyISAM. – DONE
drop supertag fields – DONE

add database UTF-8 conversion script – DONE
Additional InformationBasically it's not such a quick job as I thought it was to begin with. Definitely put it off till the next version.

https://wackowiki.org/doc/Dev/Release/R6.0/Unicode
https://wackowiki.org/doc/Dev/Release/R6.0/Unicode/DbConversion
https://wackowiki.org/doc/Dev/Release/R6.0/Unicode/DatebaseConversionScript
TagsNo tags attached.

Relationships

related to 0000163 acknowledged database language system 
related to 0000424 resolvedadministrator safehtml lib don't work propertly 
related to 0000130 resolvedadministrator Always return iso-8859-1 
related to 0000336 acknowledged Have a base language file that the localisation ones can overwrite 
related to 0000410 resolved Editor does not display cyrillic characters wysiwyg 
related to 0000418 resolvedadministrator creates a new page only with the default language 
related to 0000422 resolvedadministrator patch for htmlspecialchars(), htmlentities(), html_entity_decode() 
related to 0000434 resolvedadministrator Cyrillic letter encoding issue. 
related to 0000267 resolvedadministrator add right-to-left support 

Activities

administrator

2011-06-17 16:47

administrator   ~0000798

Last edited: 2017-12-05 16:33

View 6 revisions

Unicode (UTF-8) with PHP 5.3, MySQL 5.5 and HTML5 Cheat Sheet
-> with mbstring extention
https://wackowiki.org/doc/Dev/Guidelines/UnicodeCheatSheet

administrator

2013-12-26 08:40

administrator   ~0000908

Last edited: 2019-10-14 10:46

View 4 revisions

$string = iconv($source_codepage, 'UTF-8', $string)

- get rid of mb-string issues if any (string length, case conversion, search etc)
- create database with utf8mb4 charset and collation by default
- make a migration path for the existing installations:
  * convert each and every db string from user-specified encoding to utf-8
  * change DB encoding and collation to utf8mb4_unicode_520_ci

Issue History

Date Modified Username Field Change
2008-08-10 19:34 administrator New Issue
2008-08-10 19:34 administrator Legacy => NEW
2008-08-10 19:37 administrator Reporter administrator => Tann San
2008-08-10 19:37 administrator Description Updated
2008-08-10 19:38 administrator Additional Information Updated
2008-08-10 19:38 administrator Status new => acknowledged
2008-08-10 19:39 administrator Relationship added related to 0000163
2009-02-20 14:48 administrator Relationship added child of 0000267
2009-04-13 11:26 administrator Relationship added related to 0000130
2009-04-13 11:30 administrator Description Updated
2010-03-08 10:23 administrator Category Unicode => unicode
2011-06-17 16:36 administrator Description Updated View Revisions
2011-06-17 16:47 administrator Note Added: 0000798
2011-06-17 20:01 administrator Note Edited: 0000798 View Revisions
2011-07-30 07:01 administrator Relationship added related to 0000336
2011-10-10 12:31 administrator Note Edited: 0000798 View Revisions
2011-10-18 05:56 administrator Additional Information Updated View Revisions
2011-10-18 07:42 administrator Steps to Reproduce Updated View Revisions
2012-01-15 11:22 administrator Relationship added related to 0000410
2012-01-15 13:09 administrator Note Edited: 0000798 View Revisions
2012-01-15 13:12 administrator Note Edited: 0000798 View Revisions
2012-04-09 09:16 administrator Steps to Reproduce Updated View Revisions
2012-04-11 11:02 administrator Steps to Reproduce Updated View Revisions
2012-06-14 04:01 administrator Relationship added related to 0000418
2012-06-17 10:31 administrator Product Version => 5.0.0
2012-06-17 10:31 administrator Description Updated View Revisions
2013-01-05 10:18 administrator Target Version 5.4.0 => 7.0.x
2013-03-05 08:47 administrator Relationship added related to 0000424
2013-12-26 08:40 administrator Note Added: 0000908
2013-12-26 08:47 administrator Note Edited: 0000908 View Revisions
2013-12-26 08:47 administrator Relationship added related to 0000422
2013-12-26 08:58 administrator Assigned To => administrator
2013-12-26 08:58 administrator Priority normal => high
2014-01-06 12:13 administrator Relationship added related to 0000434
2017-12-05 16:31 administrator Steps to Reproduce Updated View Revisions
2017-12-05 16:33 administrator Note Edited: 0000798 View Revisions
2019-08-22 12:59 administrator Target Version 7.0.x => 6.0.x
2019-08-22 13:06 administrator Additional Information Updated View Revisions
2019-08-22 13:08 administrator Note Edited: 0000908 View Revisions
2019-08-22 15:22 administrator Relationship deleted child of 0000267
2019-08-22 15:22 administrator Relationship added related to 0000267
2019-09-13 09:39 administrator Status acknowledged => resolved
2019-09-13 09:39 administrator Resolution open => fixed
2019-09-13 09:39 administrator Fixed in Version => 6.0.x
2019-09-13 09:39 administrator Description Updated View Revisions
2019-10-14 10:33 administrator Fixed in Version 6.0.x => 6.0.beta1
2019-10-14 10:35 administrator Additional Information Updated View Revisions
2019-10-14 10:42 administrator Steps to Reproduce Updated View Revisions
2019-10-14 10:43 administrator Steps to Reproduce Updated View Revisions
2019-10-14 10:43 administrator Additional Information Updated View Revisions
2019-10-14 10:44 administrator Steps to Reproduce Updated View Revisions
2019-10-14 10:44 administrator Additional Information Updated View Revisions
2019-10-14 10:46 administrator Note Edited: 0000908 View Revisions
2019-10-14 10:48 administrator Steps to Reproduce Updated View Revisions
2019-10-14 10:48 administrator Additional Information Updated View Revisions