Open-Tran.eu

Online Again

2010-01-26T18:46:00.002+01:00

Open-Tran.eu is back online. I am working on configuring the FTP server. Please let me know, if you are experiencing any issues with it.

Server problems

2010-01-25T19:34:00.002+01:00

There have been issues with the server recently and I had to take the service down temporarily. I will try to restore it as soon as possible, but I'm not sure if I will be able to activate it back within the next 24 hours. I will post an update to the blog as soon as the problems have been resolved. Please excuse me all the inconvenience.

Downtime

2009-10-09T16:15:00.002+01:00

The machine running Open-Tran has been restarted four days ago. Unfortunately, I was on vacation and received the notification about the server being down while relaxing in the Dead Sea :) The service was unavailable for about 48 hours until I got back home. I apologize for any inconvenience caused and promise that this will not happen again.

In order to avoid such situations in the future, I created a cron job that periodically tries to start the web server. So in case the server ever makes a restart like this again, the service should be back up within a couple of minutes.

More Projects

2009-07-21T20:18:00.002+01:00

I am proudly announcing the following changes in the list of projects imported to the Open-Tran:

I have switched Mozilla localization to Mercurial and imported phrases from 1.9.1 branch (which, as far as I can tell, is an equivalent for Firefox 3.5).
Fedora (master) and Mandriva translations have been added.

Furthermore, I have changed the site's rendering so that the invisible elements do not show up while the site is loading.

JSON

2009-06-29T19:58:00.002+01:00

Yesterday, I added the next feature. Now, you can use JSON in order to access translation suggestions from Open-Tran. As an example consider the following request: http://en.id.open-tran.eu/json/suggest/save as. It will return a list of results encoded as JavaScript objects, but with exactly the same fields as if you retrieved the output of an XML-RPC call (see our API documentation) of suggest2('en', 'id', 'save as'). Refer to a commented excerpt of an output for more details.

Words statistics

2009-04-23T21:22:00.002+01:00

I've got one more feature for you. The words link now directs to a statistics of the most common words. The language depends on the URL-based language selection. That is: http://nl.open-tran.eu/words.html shows the most popular words for Dutch and http://af.open-tran.eu/words.html shows the most popular words for Afrikaans. You can also set 2 languages in order to have the links directing you to the appropriate comparison pages. For example: http://en.pt_br.open-tran.eu/words.html will show you the most popular English words with the links to their comparisons in Portuguese. If you have any questions regarding this feature, just let me know.

Specific phrases

2009-04-23T19:36:00.004+01:00

Here it comes - the next most requested feature has been implemented. Now, you can require that the original phrase looks exactly (or almost exactly) like you specify. In a discussion with Leandro Regueiro, Alexander Dupuy suggested a way to implement this feature in a very nice, effective way. And so now, if you enclose your phrase (or its part) in double-quotes, open-tran will only show the results that contain that phrase. As you can see in the screenshot, I requested the phrase "_save as". The server interpreted the quotes as a request to return only those results, where the original phrase included this phrase literally. So now you can go ahead and try it yourself: http://en.pt_br.open-tran.eu/suggest/"_save as".

This is not the end of news. Did you know that:

Virtaal supports Open-Tran as its Memory Translation?
Open-Tran website has been translated into twenty languages in 5 alphabets?

Periodic Updates

2009-04-15T20:26:00.002+01:00

I'd like to announce a long-awaited feature - periodic updates of the database. Me and Leonardo, have been working on this feature for more than 2 months and yesterday, the service has successfully updated itself automatically for the first time. In order to circumvent the limitations of the open-tran.eu server, we have split the importing process and distributed it between 2 servers. We are running the update twice a week, but not every execution succeeds.

There are still couple of details to be worked out: the statistics of words, phrases and projects are not updated yet and the switch still needs to be performed manually.

Search Engine Plugin

2009-02-15T20:38:00.002+01:00

Some time ago, while implementing one of the new features I had to turn off the advertising of search engines. They existed, but were not really easy to add to the browser if you didn't know the exact URL. Today, I updated the service so that the plugin is easier to add.

The combination of languages for the advertised search engine is inferred from the URL and your settings. So the search engine advertised at http://pl.en.open-tran.eu adds an engine for suggestions between Polish and English, but the one at http://de.fr.open-tran.eu adds an engine for suggestions between German and French.

Fresh import

2008-11-17T22:27:00.002+01:00

Fresh import of the translations has been uploaded to the server. By the way, I introduced the following changes to the service:

After several long outages in September, I had to adopt additional measures to prevent the server from going down with every peak of usage. I am proud to announce to you that open-tran has been working constantly for 58 days without even a single outage (see uptime statistics) despite the growth of the number of visits.
Frisian and Galician versions of the pages were updated.
Kannada was added to the list of supported languages.
Yves Savourel contributed a Java example for the use of open-tran's API. He also suggested introduction of suggest3 method for limiting the number of returned records.

New Layout: Consistency Matters

2008-08-30T20:10:00.007+01:00

I've just uploaded the prototype of the new layout to the server. You can see it by visiting the following URL: http://open-tran.eu/front.shtml.

I'd like this page to become the new front page of open-tran.eu. It is based on this set of ideas presented in the Google Redux. You may call it a shameless plagiarism, but (as far as I know) it has never been realized. I haven't asked the author yet, but I hope that he will not object.

I had the following objectives while implementing the page:

Due to the new compare functionality, the page needs to have an unlimited width, such that it might be scrolled horizontally without breaking the layout.
The new front page has to be very simple - just the search box - like... you know... Google, or something.
The contents of the current front pages will be moved to "help" (but I haven't done that, yet).
And finally... I like blue :)

I need your help again. I had to introduce some new phrases and am not 100% sure if I translated them well, so I'd like you to verify if they are correct. Obviously, I hope for more feedback and suggestions.

Known Issues
I'm not an HTML guru - it took me a lot of time to learn it well enough to bring the page to the current state. Any help will be appreciated. Furthermore, I might have done some fundamental mistakes. If you have better ideas on how to improve the site, just let me know.

You cannot select the mode yet. The search box doesn't work either. I am working on the form and the accompanying JavaScript.
For some reason, the search box border has a proper padding in Opera and IE, but not in Firefox.. I've got no idea, why.
Internet Explorer doesn't render the blue box at the top and has problems with transparent backgrounds, so the language choice looks stupid.
In some setups, the list of language choices renders incorrectly - the longest line (Biełaruskaja) breaks.
I was not able to position all the elements exactly where I wanted. The arrow (↔) is not vertically aligned, the drop down lists are not in the right positions, the submit button should probably be lower.
The logo is terrible, there is no real favicon.

I will be mailing those, who translated the page, but I know that some of them read this blog, so beware ;) If you have other questions or ideas, post a comment or send an e-mail to the mailing list.

Articles in various languages

2008-08-09T11:14:00.005+01:00

I need your advice again. In an effort to further reduce the database and provide more accurate results I am trying to exclude various types of "words" (lexemes or tokens to be precise). First, I removed all format specifiers, like %s. Next, I decided to reduce the number of words that don't carry any meaning. An obvious example from English language is the article "the". Looking up "the" in open-tran won't display any results, because the engine considers this phrase empty (no words). However, I speak only English and German. Together with my girlfriend and Wikipedia we prepared the following list of articles in several European languages:

Code	Language	List of ignored lexemes
de	German	das, dem, den, der, deren, des, dessen, die, ein, eine, einem, einen
en	English	a, an, the
es	Spanish	el, la, las, los, una, uno, unas, unos
fr	French	la, le, les, un, une
it	Italian	i, il, lo, gli, la, le, un, uno, una
pl	Polish	by
pt	Portuguese	o, os, a, as, um, uns, uma, umas

I am planning to add Dutch articles (de, een, het) in the future, too. As you can see, my table covers only 7 languages and open-tran supports more than 90. So I hope that maybe you could help me assembling similar lists for the remaining languages.

I am aware that suffixes may be used as articles in some languages (e.g. Romanian) and if you have any idea on how to tackle this issue without integration of expensive, language-specific dictionaries, then let me know.

If you have other ideas on how to improve the accuracy and/or limit the number of records stored in the database - I will appreciate your feedback. Leave a comment here, or send an e-mail to open-tran@groups.google.com. Thanks!

Compare

2008-07-09T20:25:00.002+01:00

I added new functionality to the service. Now you can compare the translations of phrases between the projects. Right now, the only way to see the comparison table is to enter an appropriate URL (or use the API). Here is an example URL:

http://pt_br.open-tran.eu/compare/zoom in

If you follow it, you will see the table with suggestions grouped by the projects, so that you can see the differences between their translations.

Do you have any idea, how I could put in on the page? Any suggestions for improvements?

Module names and fuzzy translations

2008-07-06T18:13:00.005+01:00

I have just finished the implementation, testing and processing of the newest release and am currently deploying it on the server. Below is the screenshot that depicts the new features: module names and fuzzy translation indication.

I am writing about it today, but you won't be able to see any of the results before tomorrow, when the databases are copied to the server (I've got an ADSL link at home and will need around 10 hours to send 3GB over it). I will try to restart the service before leaving to work.
UPDATE: The new version has already been deployed.

Off-line mode

2008-06-01T20:14:00.002+01:00

The off-line mode is ready for download. Here is what you need to take advantage of it:

Download the latest release of the scripts from this location.
Create .open-tran subfolder in your home directory.
Download nine-en.db (85MB) and place it in the .open-tran folder.
Download a database for your language. To do this, you need to replace en with your language code (e.g.: nine-pt_br.db for Brazilian Portuguese or nine-es.db for Spanish) and place it under .open-tran.
Extract the scripts and enjoy :)

You will find 2 executable scripts in the tarball:

suggest.py is a central part of the web service. You can use it with other Python scripts (the TranDB class has the methods described in our developers' corner). But at the same time, it is a command-line tool for retrieving suggestions. You should run it like this: suggest.py "do you really want to quit" pt_br.
open-tran.py is a GTK tool that opens a po file and provides you suggestions for them. It is a very old tool that I wrote more than year ago. I decided not to develop it any further once I learned that PyGTK is one-threaded. Yesterday I tweaked it to support the off-line mode, but I'm not going to maintain it - it was always meant to provide an example.

It is too late today, I will try to write more in the next days. Anyway, if you have any problems with it, if something crashes, if you need some improvements or don't understand how it works, if you need assistance, send an e-mail to open-tran@googlegroups.com.

Languages and cultures

2008-05-16T19:31:00.004+01:00

It turns out that there is a lot of inconsistency between the projects when it comes to the naming conventions of languages and cultures. So I thought that maybe someone could help me. Right now I am making the following assumptions:

For any language code ab: ab_AB is the same as ab
fy_NL is the same as fy
ga_IE is the same as ga
hy_AM is the same as hy
nb_NO is the same as nb
nn_NO is the same as nn
nds_DE is the same as nds
sv_SE is the same as sv
ur_PK is the same as ur

However, I was not able to determine, if the following language codes are really the same:

bn_in and bn
gu_in and gu
pa_in and pa
no and (nb or nn)
nds_NFE and nds

I suppose they are the same, but I wouldn't like to offend anybody, so I put those on hold. If my reasoning is wrong, please let me know, so that I could fix it.

More updates

2008-05-15T20:01:00.003+01:00

I'm going nuts with KDE's anonymous svn access. It is sooooo slow. I am trying to upload the latest version of translations and once a while it just stalls... I have to regularly kill the subversion client, then run cleanup. And it seems that they are throttling the bandwidth to about 10K/s. Anyway, I managed to download and run the first step of import for openSUSE and XFCE, so you can expect them in the nearest future with the updated translations for KDE (this time KDE4), GNOME and Mozilla. I have also automated the updates, so I should be able to update the database more frequently.

Furthermore, I have created a discussion group for anybody interested in open-tran. If you have any suggestions or questions, you can post an e-mail to open-tran@googlegroups.com. You don't have to be a subscriber to post messages.

And by the way, I've got two questions for you:

Have you noticed any performance improvement after the last upgrade?
Would you download the database for off-line use (~100MB)?

Implementation

2008-05-11T18:35:00.004+01:00

Eventually, every plan needs to be executed. I am very proud to be able to let you know that my plan has finally been implemented and the new version of open-tran has been deployed on the server. I hope that the response times will be better now. I am now working on the rest of my plan: soon you should be able to download the database for off-line use and some new translation sources should be added. Keep your fingers crossed!

BTW: I updated the python snippet, which included the wrong URL for accessing the service via XML-RPC. Only Python implementation adds /RPC2 automatically to the server's address. Please visit our developers' corner for more details.

Plans

2008-05-04T15:36:00.004+01:00

I thought that you might be interested in the plans I have regarding this service and the directions of its development. Recently I started digging in the code and (since every test takes some time) I decided to give you an outlook on what I am working on right now. So here we go:

Monitoring. Sometimes things just don't work. And open-tran.eu may go down once a while due to unknown reasons. Few weeks ago I decided to start monitoring the website in order to provide constant service. There were few bogus outages, but it already proved useful in April, when the site went down. In the right pane of this blog you will find a button that leads to public uptime statistics for the site:
Better performance. I decided to reorganize the database a little bit and make it more compact. Right now I am working with a set of 3 languages on my local computer and the results look promising. If everything goes right, I should upgrade the service in the coming week.
Off-line mode. New database schema will allow downloading an arbitrary set of languages for off-line use. One language pair will require approximately 100MB space and will provide exactly the same functionality (but using a desktop app). I will provide the databases and a set of console tools for updating the database and accessing the translations. The complete documentation will also be posted on the website.
openSUSE translations. The openSUSE translations were brought to my attention by their maintainers. Adding them to the database looks like a piece of cake, so this is going to be the first thing I will do as soon as the upgrade is complete.

There is one small disadvantage of the new release. It won't be possible to trace the translation back to its source, because this information is dropped in order to make the database more compact. You will still be able to see which project uses this translation and how many times, but that will be all. If you have any comments or other ideas, just post a comment or send me an e-mail.

New Design

2008-01-16T10:45:00.000+01:00

Finally, I have found some time to redesign the site. Some features have been disabled for now and some links don't work correctly. Nevertheless, I think that the new version is much better. You don't have to encrypt source and destination languages in the domain name anymore, you can choose both languages from drop-down lists. Your choice of locale is now going to persist, regardless of source and destination languages. Let me know what you think about the new layout.

Long time no hear

2007-11-18T18:35:00.000+01:00

A lot has changed since I last wrote. The most important improvement is that open-tran.eu is now able to translate between any pair of languages. As an example consider the following address:

http://ca.es.open-tran.eu

This site may be used to fetch suggestions of translations between Catalan and Spanish. Similarly, http://fy.nl.open-tran.eu will serve the same for Frysian and Dutch.

You will also notice that I have added new sources of translation and fixed several defects [1], [2]. So check out how open-tran.eu works now and let me know if you experience any problems with it.

East or West, Open-Tran.eu Is Trying to Be the Best

2007-05-08T16:41:00.000+01:00

Youssef Chahibi has notified me of a wrong website rendering in certain languages on the search results page. Clearly, some languages require the right-to-left rendering. Thus, I have updated the service to render the Arabic, Persian, Hausa and Hebrew versions from right to left and to align the results to the right.
C. Jousma has translated the Open-Tran.eu website into Frisian.

Original Phrases

2007-05-03T17:38:00.000+01:00

Today, I have implemented the most frequently requested feature. Original phrases are now displayed along with the translation suggestions.

More Improvements

2007-04-30T17:40:00.000+01:00

I have changed the way the suggestions are presented on the results page. All you will see now will be a list of phrases with a compact information summarizing how many times they appear in GNOME, KDE and Mozilla (in the alphabetical order). Clicking on the phrase uncovers a list of projects with links to the respective files.
Siegfried-Angel Gevatter Pujals has translated the Open-Tran.eu website into Catalan.
In case you haven't yet read Goofy's comment on one of the previous posts: the Open-Tran Firefox extension is available for easy installation from addons.mozilla.org.

More and More

2007-04-15T21:21:00.000+01:00

Mikkis and Nicola Ruggero have translated the Open-Tran.eu website into Finnish and Italian, respectively. If your language version is still not supported and you would like to change it, there are couple of rules you should follow:

Start by downloading the English set of HTML files: en.tar.gz.
The search results are utf-8 encoded, thus all the files have to be utf-8 encoded as well.
You can rename the files (except index.html, of course) if you update the template but please, use only Latin characters in the file names.
Update contact information so that it does not encourage people to translate the site anymore. I would also appreciate it, if you added your contact information for people willing to share their problems in your native language.
Additionally, a translation of the phrase "Translation suggestions" is needed.

Oh... and don't forget to give me a link to your website so that I can list you in our Hall of Fame. You may also choose to remain anonymous, just like the translator of the Danish version.

Even More Tools and Versions

2007-04-11T20:46:00.000+01:00

I am proud to announce that:

The Open-Tran website has been translated into Danish.
I have created a gadget which you can add to your personalized Google home page. It looks like this:

In order to use it, you only need to click this button: . You can also go to your personalized Google home page and add the gadget's URL: http://open-tran.eu/open-tran.xml.

New Versions, New Languages, New Tools

2007-04-08T21:36:00.000+01:00

Some of you may have already spotted that the open-tran.eu service is constantly changing.

Michôł Òstrowsczi, Іван Петрущак and the French Babelzilla Team have volunteered to translate the site into Kashubian, Ukrainian and French, respectively.
During the last import, two additional languages have been included and you can now check the translation suggestions in British English and Malagasy. This makes up 89 languages altogether.
Jean-Bernard Marcon (Goofy) created a Firefox extension that lets you look up a translation suggestion of any selected text.

Legal Matters

2007-04-01T13:46:00.000+01:00

I've recently taken part in a lengthy discussion about legal issues around open-tran.eu and now I'd like to write its short and subjective summary.

Some people have claimed that open-tran.eu infringes the copyrights of the Mozilla Foundation.
I don't share this point of view. GPL has been created in order to protect the open-source software from being used in non-open solutions. Regardless of the details behind the law-language, open-tran.eu does not violate the principle of software (and other resources used to build it) being free.
However, I extended the information about the database with links to the licenses of all the imported projects and issues around them. You, as a user of open-tran.eu, must be aware of the fact that the translations are protected with the respective license terms and it is your responsibility to obey them.

Gnome Imported

2007-03-27T20:37:00.000+01:00

Today, the database has been extended with Gnome's translations (from the trunk) into 74 languages. I believe I can claim open-tran.eu to be the world's largest software dictionary.

Design

2007-03-25T21:23:00.000+01:00

I have downloaded the current design of the open-tran.eu from the oswd website and slightly modified it to include the search form. It is not only my opinion that this design does not look very well. So if you have some time and would like to create a new one, please contact me. I will reference you in the site's footer and our Hall of Fame. And by the way: I have extended the layout of the results. I have removed this horrible table and replaced it with a definition list, which now includes some additional information: a complete list of projects that contain the suggested translation and a number indicating the score. I hope that these visual clues will help comprehend the list.

Mozilla Imported

2007-03-20T18:19:00.000+01:00

Today, the database has been extended with Mozilla's translations (from the 1.8 branch) into 45 languages. If you have any idea where I could find a publicly available repository with Gnome's translations, please leave a comment to this post or edit the appropriate bug.

Translation Origin

2007-03-18T18:22:00.001+01:00

I have implemented the most frequently requested feature, i.e., information about the origin of a translated phrase. It has been done with the least effort possible, but will be completely rebuilt in order to pack many additional information about each suggestion (e.g. score, source phrase, etc.)

Supplements and Fixes

2007-03-16T18:24:00.000+01:00

Few things changed since my last post. And I can now proudly announce that the KDE translations have been fully imported including the four missing languages:

Additionally, several misspellings have been corrected and the problem with several language variants has been fixed.

Launch Day

2007-03-11T16:00:00.000+01:00

I've had a busy weekend.

I have launched this blog to keep everybody up to date with the current status of the project.
I have managed to add 71 languages to open-tran.eu. It might be the case that I have misspelled some of the names or put them in a wrong form (I am particularly unsure about the Ukrainian - it looks to me rather like a feminine adjective), so please drop me a line if you know how to correct them. I am still working on few languages that failed to import (Kashubian, Hausa, Georgian and Telugu) and will let you know as soon as I find out what went wrong.
I have also populated the database with the newest KDE translations from the stable branch. Right now the database is about 700MB large and contains more than 5 million phrases in 83 different languages.
The software running open-tran.eu is now available for download from the project's site. You are also encouraged to submit any bugs and feature requests into the issue tracker.