LinuxQuestions.org
LinuxAnswers - the LQ Linux tutorial section.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Slackware
User Name
Password
Slackware This Forum is for the discussion of Slackware Linux.

Notices

Reply
 
LinkBack Search this Thread
Old 08-14-2013, 08:12 AM   #1
vargus
LQ Newbie
 
Registered: Aug 2013
Posts: 3

Rep: Reputation: Disabled
[Request] Python with Unicode4 support


Dear Slackware developers,

as I ran into an issue today while using external libraries via python (CPLEX in this case), I'd like to ask what the stance on Unicode is.

By default, python is built with support for 16bit Unicode only, i.e. --enable-unicode=ucs2.
But many distributions nowadays have switched to compiling with --enable-unicode=ucs4, which prompted third-party developers to ship their binaries/libraries accordingly, making them impossible to use in Slackware without recompiling python itself and all its dependencies.

The reason I can see against adding configure parameters is the purity and cleanliness of the slackware-shipped binaries, but it doesn't have any other disadvantages I know of.
 
Old 08-14-2013, 09:42 AM   #2
bosth
Member
 
Registered: Apr 2011
Posts: 217

Rep: Reputation: 60
I've never figured out why anyone would want to use UTF-16, let alone UCS-2.
 
Old 08-14-2013, 11:23 AM   #3
dugan
Senior Member
 
Registered: Nov 2003
Location: Canada
Distribution: distro hopper
Posts: 4,238

Rep: Reputation: 1299Reputation: 1299Reputation: 1299Reputation: 1299Reputation: 1299Reputation: 1299Reputation: 1299Reputation: 1299Reputation: 1299
Quote:
which prompted third-party developers to ship their binaries/libraries accordingly,
Are there any examples other than CPLEX?

Last edited by dugan; 08-14-2013 at 11:30 AM.
 
Old 08-14-2013, 12:17 PM   #4
vargus
LQ Newbie
 
Registered: Aug 2013
Posts: 3

Original Poster
Rep: Reputation: Disabled
As, granted, the number of applications relying on this isn't very high, I mostly found references to openssl which is e.g. used in the software "OpsCenter" by Datastax. (googling for PyUnicodeUCS4_Decode and PyUnicodeUCS2_Decode).
 
Old 08-14-2013, 12:47 PM   #5
ponce
Senior Member
 
Registered: Aug 2004
Location: Pisa, Italy
Distribution: Slackware
Posts: 2,314

Rep: Reputation: 816Reputation: 816Reputation: 816Reputation: 816Reputation: 816Reputation: 816Reputation: 816
looking at this two links

http://community.activestate.com/node/9371
http://stackoverflow.com/questions/1...-unicode-error

I'm thinking if it's there any serious reason to switch to ucs4 from the default ucs2, as the two modes are incompatible, just for solving this two special cases you cite: not that it matters much (I think), but for personal curiosity which are the distributions that are using ucs4?
maybe it's IBM that it's just releasing the python components with this default to conform to a specific distribution to certify its product on a specific platform...

Last edited by ponce; 08-14-2013 at 12:54 PM.
 
Old 08-14-2013, 12:54 PM   #6
GazL
Senior Member
 
Registered: May 2008
Posts: 3,231

Rep: Reputation: 828Reputation: 828Reputation: 828Reputation: 828Reputation: 828Reputation: 828Reputation: 828
glibc uses a 32bit wchar. I don't know whether that has any bearing on python's internal unicode handling but it might explain why some of the other distros have opted for the ucs4 option.

Which distros are using ucs4? For the sake of compatibility it's probably best to run with the crowd and do whatever Redhat and debian are doing (assuming they're using the same setting of course).

Last edited by GazL; 08-14-2013 at 01:01 PM.
 
Old 08-14-2013, 02:06 PM   #7
fskmh
Member
 
Registered: Jun 2002
Location: South Africa
Distribution: Slackware64-current multilib
Posts: 225

Rep: Reputation: 52
I gave it a try here and so far it's required me to recompile sip, PyQt and a bunch of other non-standard Slack packages like numpy, scipy etc.
 
Old 08-15-2013, 04:03 AM   #8
vargus
LQ Newbie
 
Registered: Aug 2013
Posts: 3

Original Poster
Rep: Reputation: Disabled
http://mail.python.org/pipermail/pyt...er/091933.html
Old post, but Debian and Fedora have switched to UCS4 years ago, don't know the current state of Archlinux though.
Edit: I didn't mention things like numpy and scipy because most users compile them manually anyway, it's more an issue with commercial libraries.

Last edited by vargus; 08-15-2013 at 04:05 AM.
 
Old 08-16-2013, 07:53 AM   #9
_ZeD_
LQ Newbie
 
Registered: May 2012
Distribution: Slackware
Posts: 18

Rep: Reputation: 1
btw: python 3.3 dropped the compilation flag; see http://www.python.org/dev/peps/pep-0393/
 
1 members found this post helpful.
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Request: Apache 2.4 with lua support codeguy Slackware 11 08-02-2013 05:45 AM
Python Request Persistent metallica1973 Programming 1 05-11-2013 12:47 PM
Request for Postgresql client and php support codeguy Slackware 2 09-11-2011 08:44 PM
iTunes feedback request Linux support matthekc Linux - General 2 07-24-2009 02:58 PM
HTTP::Request and CPAN support amer_58 Linux - Newbie 2 03-30-2005 11:46 AM


All times are GMT -5. The time now is 09:12 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration