http://pnotepad.org/forums/tags/utf-8 Programmer's Notepad Forums en-US Thu, 09 Feb 2012 07:09:28 +0000 http://bbpress.org/?v=1.0.3 q http://pnotepad.org/forums/search.php http://pnotepad.org/forums/topic/5128#post-7559 Mon, 10 Jan 2011 18:22:53 +0000 simon 7559@http://pnotepad.org/forums/ <p>Hmm, yes I probably hadn't considered those cases. Please file a request here:</p> <p><a href="http://code.google.com/p/pnotepad/issues/entry" rel="nofollow">http://code.google.com/p/pnotepad/issues/entry</a> </p> http://pnotepad.org/forums/topic/5128#post-7532 Tue, 04 Jan 2011 17:36:08 +0000 airmw 7532@http://pnotepad.org/forums/ <p>I have UTF-8 set as the default encoding, however, this will only work if I start a new document from within PN. If I create a blank new document via the command line (pn.exe %1) or by creating a blank new file (foo.txt) the encoding defaults to ANSI. </p> http://pnotepad.org/forums/topic/2025#post-7395 Fri, 01 Oct 2010 13:32:05 +0000 simon 7395@http://pnotepad.org/forums/ <p>This is the same as the Replace All bug that you reported above. I don't have the code here as I'm at work, so can't debug it, but I suspect that when you convert "ż" to Windows-1252 rather than UTF-8 we are getting a fallback character which is z. Therefore the replacement is finding z.</p> <p>When I fix the Replace All bug this will go away too. </p> http://pnotepad.org/forums/topic/2025#post-7392 Fri, 01 Oct 2010 07:50:03 +0000 rc-flitzer 7392@http://pnotepad.org/forums/ <p>When it says “2 occurrence(s) replaced.”, it has indeed replaced two characters, but not the ż … Try replacing with e.g. “M”, then you will see the result: Mażółć. Long story short: it replaces the wrong character.<br /> This is a serious thing. Why will a character like ż be treated as z? </p> http://pnotepad.org/forums/topic/2025#post-7389 Thu, 30 Sep 2010 21:12:25 +0000 Nux 7389@http://pnotepad.org/forums/ <p>In my case I have a file:</p> <blockquote><p> zażółć<br /> zażółć </p></blockquote> <p>And I'm replacing all "ż" with "z". It says "2 occurrence(s) replaced." but nothing is replaced.</p> <p>I've also found something that might be related, but I'm not sure if it's about display or selection...<br /> <a href="http://code.google.com/p/pnotepad/issues/detail?id=1077" rel="nofollow">http://code.google.com/p/pnotepad/issues/detail?id=1077</a></p> <p>But I'm very happy it works at all :-). </p> http://pnotepad.org/forums/topic/2025#post-7385 Thu, 30 Sep 2010 15:17:35 +0000 simon 7385@http://pnotepad.org/forums/ <p>Great, thanks for the feedback - 2.2 will be a much better release thanks to you!</p> <p>I'll look at the Replace All thing. </p> http://pnotepad.org/forums/topic/2025#post-7384 Thu, 30 Sep 2010 14:44:41 +0000 rc-flitzer 7384@http://pnotepad.org/forums/ <p>Very nice :-) Now this is how I wanted PNotepad to be. Search/replace works well. Oh I found another bug: “replace all” doesn’t work in UTF-8 mode. He still says „0 occurences replaced”, though replacing one by one works. But I think this is the last bug. ;) </p> http://pnotepad.org/forums/topic/2025#post-7383 Thu, 30 Sep 2010 14:12:17 +0000 simon 7383@http://pnotepad.org/forums/ <p>@rc-flitzer No problem, thanks for continuing to provide feedback!</p> <p>I've uploaded a portable build with two changes here:</p> <p><a href="http://pnotepad.googlecode.com/files/portable-pn2152224.zip" rel="nofollow">http://pnotepad.googlecode.com/files/portable-pn2152224.zip</a></p> <p>Change 1: As detailed above, switch to Default Encoding<br /> Change 2: Fix issue with passing selection into Find Dialog when using UTF-8</p> <p>As part of Change 1, the UTF-8 conversion thing is fixed. When I explained what I had done above, I meant to say that this was a bug and not what I had intended :)</p> <p>Hopefully this will get us closer to where it needs to be. </p> http://pnotepad.org/forums/topic/2025#post-7382 Thu, 30 Sep 2010 07:29:27 +0000 rc-flitzer 7382@http://pnotepad.org/forums/ <p>I'm sorry about yesterday. This was not an appropriate tone, I was a bit harsh.<br /> Your changes sound good. Do you want to send me a copy of the testing build? The e-mail adress should be available for you as forum administrator.</p> <p>"Of course if your default code page is UTF-8 then you get UTF-8 rather than any ANSI encoding."<br /> Hm, that's quite wrong. Convert to ANSI should always do what it says. *g* In N++ there is no difference between utf-8, utf-16 and several 8-Bit-Encodings. You either say "this file now has this encoding" or you say "convert to that encoding". For new files there is an option (settings -&gt; new/open/save) where you set either ANSI, UTF-8 (with/out BOM) or some UTF-16 (UCS-2? That's old.) variant.</p> <p>On second thought, your menu structure for encoding is quite ok. You can set an encoding for new files and you can convert files to other encodings. It just has to work properly.^^</p> <p>About search / replace: now it works, strange. Sometimes it adds some characters to the beginning or end of the file. And a second bug: if you have marked some characters for replacing, the search box contains the characters as ANSI encoded bytes, e.g. if I mark "ä", then search/replace, the search box contains "ä". Of course only when my current file is UTF-8. This is again something where you give utf-8 some different behaviour instead of treating it as just a different encoding... (Seems to me you never even thought of UTF-8 when writing the first versions. *g*) </p> http://pnotepad.org/forums/topic/2025#post-7380 Wed, 29 Sep 2010 21:06:33 +0000 simon 7380@http://pnotepad.org/forums/ <p>Ok, I have done the work to switch to default encoding. There are still two options, but they are different and now more clear:</p> <p>`<br /> Default Encoding: [ANSI ]<br /> UTF-8<br /> UTF-8 No BOM<br /> UTF-16 Little Endian<br /> UTF-16 Big Endian</p> <p>Multi-Byte Character Support for ANSI: [Default ]<br /> Chinese Big 5<br /> etc.</p> <p>The character set option is gone and is unlikely to return, the above should be enough. I'm happy to provide a private testing build to anyone to try this out and give feedback before the release. Let me know!</p> <p>Also still interested in search bugs when UTF-8 encoding is in use. </p> http://pnotepad.org/forums/topic/2025#post-7379 Wed, 29 Sep 2010 16:46:00 +0000 simon 7379@http://pnotepad.org/forums/ <p>Also, I will of course look at the Notepad++ options later and see what they do differently. </p> http://pnotepad.org/forums/topic/2025#post-7378 Wed, 29 Sep 2010 16:45:42 +0000 simon 7378@http://pnotepad.org/forums/ <p>Sorry about this, clearly still some work to do.</p> <p>The problem with converting to ANSI is caused because I use the default code page when converting to ANSI. Of course if your default code page is UTF-8 then you get UTF-8 rather than any ANSI encoding.</p> <p>I guess what I really want to make available is:</p> <p>1. Default encoding for new files.<br /> 2. Default code page for ANSI files (?)</p> <p>All other settings should be hidden.</p> <p>As for Search, I'm surprised that's not working. For example, if I use the above utf-8.txt example file and search for ÊËÌÍÎÏ then it finds both upper and lowercase versions which is as I expect. Could you provide repro steps? </p> http://pnotepad.org/forums/topic/2025#post-7377 Wed, 29 Sep 2010 15:12:39 +0000 rc-flitzer 7377@http://pnotepad.org/forums/ <p>"Right way to fix"? No. Still not fixed. (I'm sorry for not checking the forum a longer time, but I started a new job and it is quite time-intense.)</p> <p>I set Options -&gt; General -&gt; Defaults -&gt; Code Page to "UTF-8", because I want new documents to be created as UTF-8 ones. But we still are not able to open our old ANSI encoded documents without hassle. See point 1 in my first posting.<br /> And I can't create anymore ANSI documents. If you have (with UTF-8 setting) an open utf-8 document, convert it to ANSI and store it, it is still utf-8 (without BOM). Not that I want to convert _to_ ANSI, but a bug is a bug. *sigh*</p> <p>Why do you still have this kind of double or triple setting? And all this unicode/ansi not really running code? There is "Code Page", "Character Set" and "Encoding" (in "File" menu). This is not useful. I mentioned this way more than a year ago and also gave you the solution: just make _one_ setting for an encoding/character set the user wants to have.</p> <p>I'll tell you what. Make UTF-8/encoding support the same as in Notepad++. And make the settings the same. Look at its "Encoding" menu and you'll see what I mean. It is just _simple_ and it works.</p> <p>... and search / replace still is unusable in UTF-8. </p> http://pnotepad.org/forums/topic/2025#post-7342 Wed, 01 Sep 2010 22:21:44 +0000 simon 7342@http://pnotepad.org/forums/ <p>Happy to say that verison 2.1.5 (due for release shortly) will include encoding conversion between UTF-* and ANSI. This should solve this for good!</p> <p>My thanks to rc-flitzer, and all those who reported bugs that helped me find the right way to fix this. </p> http://pnotepad.org/forums/topic/2025#post-7301 Wed, 18 Aug 2010 17:25:34 +0000 horus 7301@http://pnotepad.org/forums/ <p>Yeah, I'm also quite annoyed by this problem. But I also see that PN2 is quite good at detecting BOM-less UTF-8 files. So maybe it's not really necessary to set "Code Page" to UTF-8; just default should be good enough.</p> <p>However, there're two related bugs which prevents us from using UTF-8 without fear of losing data:<br /> <a href="http://code.google.com/p/pnotepad/issues/detail?id=1020" rel="nofollow">http://code.google.com/p/pnotepad/issues/detail?id=1020</a><br /> <a href="http://code.google.com/p/pnotepad/issues/detail?id=1021" rel="nofollow">http://code.google.com/p/pnotepad/issues/detail?id=1021</a></p> <p>If these two bugs are fixed, PN2 could reach another level of perfection :) </p> http://pnotepad.org/forums/topic/2776#post-5068 Sun, 09 May 2010 16:02:43 +0000 rc-flitzer 5068@http://pnotepad.org/forums/ <p>Sorry for the late answer. I created a bug report (Issue 906) and hope it helps. If you need I can provide you with an example of my test file, but it really goes with every non-ASCII char. You should be able to type one yourself or use charmap.exe. </p> http://pnotepad.org/forums/topic/2776#post-4849 Tue, 04 May 2010 12:59:25 +0000 simon 4849@http://pnotepad.org/forums/ <p>Hi, please let me know which version of PN you're using for these problems. I'd like to make sure they're fixed. There are lots of improvements for unicode support in 2.1.x but there may still be bugs. </p> http://pnotepad.org/forums/topic/2776#post-4842 Sat, 01 May 2010 10:23:33 +0000 rc-flitzer 4842@http://pnotepad.org/forums/ <p>This is working but only in ANSI-mode. Not in UTF-8 mode. Seems there are STILL a lot of problems using UTF-8. :-(<br /> I recently wanted to replaced the - (hyphen) with a – (en-dash). Didn’t work with replace all. But also somehow did not work using manual replacement. I had to use the search function and for each occurrence press Strg-V to replace it. </p> http://pnotepad.org/forums/topic/2776#post-4837 Wed, 28 Apr 2010 18:32:41 +0000 omli 4837@http://pnotepad.org/forums/ <p>Replace All button isn't working for "’" (this inside double quotes) . I'm trying to replace "’" with "'", but nothing happens. I have to click Replace button many times. </p> http://pnotepad.org/forums/topic/2025#post-4099 Wed, 14 Apr 2010 10:58:33 +0000 rc-flitzer 4099@http://pnotepad.org/forums/ <p>I created a file which has all german umlauts (äöü and ß) in a line. Then there are all 122 non-ASCII characters from Windows-1252 in another line. This has been saved both with encodings Windows-1252 and UTF-8 (with BOM). Is this helpful? Most European Windows versions use 1252. For Kyrillic and other encodings (Chinese, Thai, Turkish) it's a bit more complicated to create these files, but I could also do this if neccassary.</p> <p><a href="http://rainer-grabbe.de/developer/pnotepad/windows-1252.txt" rel="nofollow">http://rainer-grabbe.de/developer/pnotepad/windows-1252.txt</a><br /> <a href="http://rainer-grabbe.de/developer/pnotepad/utf-8.txt" rel="nofollow">http://rainer-grabbe.de/developer/pnotepad/utf-8.txt</a><br /> Maybe your browser does not display any text in one of these files because of encoding. Simply save them. </p> http://pnotepad.org/forums/topic/2025#post-4098 Wed, 14 Apr 2010 08:15:45 +0000 simon 4098@http://pnotepad.org/forums/ <p>Hi, thanks for the feedback. I really would like to get this stuff fixed, and sorry I haven't got around to it yet. I'll try and prioritise these bugs, but maybe you could help:</p> <p>What would make these requests easier to work on would be a set of sample files that I can use to verify results, so for each conversion that I might do:</p> <p>1. Open source file [x]<br /> 2. Convert to encoding blah<br /> 3. Save as new file, and compare to file [y]</p> <p>If I had a set of x and y that were known to be good, then testing this is much easier. If you were willing to help on this (or anyone else for that matter, code or samples) it might speed things along.</p> <p>Thanks. </p> http://pnotepad.org/forums/topic/2025#post-4069 Tue, 13 Apr 2010 09:45:38 +0000 rc-flitzer 4069@http://pnotepad.org/forums/ <p>Hello!<br /> At first I'd like to thank you, Simon, for the newest version 2.1. It has been a while since I looked here for new versions and this one impresses me. Native support for extensions without the need to install Python (and a nice text sorting extension) and native UTF-8 support, finally. You see, UTF-8 is the future, but already for years, so PNotepad was already late. ;-)</p> <p>If you only edit UTF-8 files everything is nice. But I also have many many old ANSI (1252) files, and it would be great to use PNotepad as all-purpose editor for both encodings. Here is why is that not yet possible:</p> <p>1. I want to create new files automatically in UTF-8. But when I set „Code Page“ to Unicode (UTF-8), all opened ANSI files (with automatc encoding recognition) are displayed wrong. The editor recognizes ANSI encoding and says so in status line, but instead of an „ü“ I only get a square with „FC“ written in it. So it seems a bug: the text window wants to display the text in UTF-8, but it is ANSI and it should be displayed so.<br /> That's really annoying. Either I can't open my old ANSI files properly or I manually have to change encoding from ANSI to UTF-8 on every single new-created document.</p> <p>2. There is still no easy conversion between encodings, which I proposed in July 2008: <a href="http://pnotepad.org/forums/topic/443#post-1558" rel="nofollow">http://pnotepad.org/forums/topic/443#post-1558</a><br /> And yes, I rechecked the behaviour. It's still the same. It would be so easy to implement an option to set/change the encoding in the save dialog window.</p> <p>I already created two bug reports (875 and 876) for these issues. Hopefully I'm waiting for them to be finished (at least 875). :-) </p> http://pnotepad.org/forums/topic/442#post-1708 Mon, 10 Nov 2008 19:51:10 +0000 rc-flitzer 1708@http://pnotepad.org/forums/ <p>Good news!<br /> I switched Python from 2.5.2 to 2.6, now everything works fine, especially PNotepad und PyPN. :) Since no other application is bothered by this I'll leave it so.</p> <p>Thanks for the help. :-) </p> http://pnotepad.org/forums/topic/442#post-1706 Mon, 10 Nov 2008 11:43:22 +0000 simon 1706@http://pnotepad.org/forums/ <p>I have seen at least one case of TortoiseHg causing PyPN to fail. I think they use a non-standard build of python and because it's always loaded (the shell extension gets loaded into the PN process) we end up seeing their version of the dll. I haven't found a way to resolve this yet.</p> <p>Also: Yes, I'm looking into mail notification. </p> http://pnotepad.org/forums/topic/442#post-1705 Mon, 10 Nov 2008 11:23:44 +0000 rc-flitzer 1705@http://pnotepad.org/forums/ <p>... sorry for the late answer. It seems that this forum needs an e-mail notification for I can't check all my used forums every day for new answers. :(</p> <p>To your checking questions:<br /> 1. I have installed Python in "D:\Sprachen\Python25", so it's not a standard path, but all are ascii chars.<br /> 2. I will test Python 2.6 ...<br /> 3. Hm there's at one in c:\windows\system32, which is the first to be found in PATH. There's another one used by TortoiseHg (version control system), the folder is also in PATH but after the system folder. I'll check this. [...] no, removing the folder from PATH didn't help. </p> http://pnotepad.org/forums/topic/442#post-1677 Sun, 26 Oct 2008 21:28:01 +0000 simon 1677@http://pnotepad.org/forums/ <p>Also, are there any extra copies of Python25.dll on your system, or only the main installed one? </p> http://pnotepad.org/forums/topic/442#post-1676 Sun, 26 Oct 2008 21:05:21 +0000 simon 1676@http://pnotepad.org/forums/ <p>Hi, sorry to hear it's still not working :(</p> <p>I just had a look at the dump file and the failure is happening just after we initialize python (the very first time I try to do something with it).</p> <p>Could you please let me know the following:</p> <p>1. Path that you have installed python in?</p> <p>It may be that if you have installed python in somewhere other than the default location (e.g. a path with spaces, or unicode characters) that this might be causing problems.</p> <p>2. Does Python 2.6 with the 2.6 version of PyPN work (if you can try)?</p> <p>I'll have a look and see if there's anything else I can find out about this type of problem, I've not seen it before. </p> http://pnotepad.org/forums/topic/442#post-1675 Sat, 25 Oct 2008 12:39:25 +0000 rc-flitzer 1675@http://pnotepad.org/forums/ <p>Hello again!</p> <p>I removed all user settings from PNotepad and reinstalled it (runs fine). Then I registered PyPN. Without any extra changes to the configuration I get the same error message again: "Programmer's Notepad 2 has experienced an unexpected problem and is going to close, we apologise for this inconvenience."</p> <p>The dump file is available at the same address posted above. I also uploaded my settings folder here:<br /> <a href="http://home.arcor.de/sagem-x-5/pn/settings.7z" rel="nofollow">http://home.arcor.de/sagem-x-5/pn/settings.7z</a></p> <p>Please help me, I still can't use PyPN. </p> http://pnotepad.org/forums/topic/442#post-1674 Fri, 24 Oct 2008 19:19:17 +0000 rc-flitzer 1674@http://pnotepad.org/forums/ <p>Hello!</p> <p>I just installed the latest development version 2.0.9-853-devel, trying to use PyPn 0.9.853 for Python 2.5. I have installed Python 2.5.2 on my system. The same error as described above still occurs. PNotepad won't start when PyPN extension is registered in config.xml.</p> <p>I have uploaded the dump file on my personal webspace here:<br /> <a href="http://home.arcor.de/sagem-x-5/pn/PN2_2.0.9.853.dmp" rel="nofollow">http://home.arcor.de/sagem-x-5/pn/PN2_2.0.9.853.dmp</a></p> <p>Will it help posting my configuration of PNotepad? Maybe there is something wrong. I will try installing again in a fresh profile, could help... I'm a bit disappointed because I can't use PyPN for months. :( </p> http://pnotepad.org/forums/topic/442#post-1604 Sun, 10 Aug 2008 12:44:29 +0000 rc-flitzer 1604@http://pnotepad.org/forums/ <p>Hello!<br /> Any success yet? I mean it's not immediate for me having this functionality. At the moment PNotepad does its job fine. :) But as there is a mighty plugin system I'm curious and want to try it. </p>