Pike-devel

pike-devel@lists.lysator.liu.se

2 participants
3046 discussions

Pike 8.0 verify fails
by Stephen R. van den Berg 15 Nov '17

15 Nov '17

For ages already, the standard "make verify" in xenofarm on devel2.cuci.nl fails consistently (segfaults, basically). I decided to investigate, only to notice that it crashes running "test_pike testsuite" in encode.c trying to execute inline assembly that has not been relocated because it has no relocation information (but it *does* contain at least two references that need to be relocated). This occurs really early in the startup process. This happens using -O3, without RTL-debug. Then I tried running without C-optimisation; and it seems that still goes wrong. Trying to trace that code in gdb is a !@#$%^&*() nightmare due to the multiple include macros being used as templates in that file. When running that with RTL-debug turned on, the problem goes away (but you get back other problems, see recent verify runs). I gave up for the moment. -- Stephen.

1 0

Crypto.SCRAM New proposed module
by Stephen R. van den Berg 13 Nov '17

13 Nov '17

A proposed new class, currently in 8.1. It implements the SCRAM protocol. The implementation has already been battle-tested in pgsql in 8.1. Any suggestions related to functionality, interface and/or naming? Because I like to keep the implementation of pgsql in 8.0 and 8.1 mostly in sync, I would like this class to be backported to 8.0 as well. -- Stephen.

1 2

Pike conference 2017
by Tobias S. Josefowitz 09 Oct '17

09 Oct '17

Hi, we invite you to this year's Pike developer conference on the weekend of the 3th, 4th and 5th of November 2017. Opera Software will host the conference in its offices in Linköping on the 4th and 5th. Everyone who is already around on late-afternoon of the 3rd is invited for fika at the Roxen offices starting from 15:00. On saturday and sunday we meet at the Opera offices (Repslagaregatan 21) starting from 10:00. Just call "Opera Software" using the fancy door-bell-replacement technology available at the entrance. If you intend to join, please consider dropping me an email to let me know, but you are most welcome even if you do not. Also you are most welcome to send me an email if you have any other questions, like "Ok, where is this Roxen office anyway?", or really anything. If there is something you would like to put on the agenda for the conference, please also just send me an email. On behalf of the 2017 conference committee, Tobi

1 0

Pike 8.0.498 release candidate
by Peter Bortas 06 Oct '17

06 Oct '17

Pike 8.0.498 release candidate: https://pike.lysator.liu.se/pub/pike/beta/8.0.498/Pike-v8.0.498.tar.gz Other builds: https://pike.lysator.liu.se/pub/pike/beta/8.0.498/Pike-v8.0.498-Darwin-15.4… https://pike.lysator.liu.se/pub/pike/beta/8.0.498/Pike-v8.0.498-win32-oldli… Relevant changes since yesterdays release candidate, fix of documentation in CHANGES: - - Crypto.ECC.Curve.Point objects can now be compared with _equal(). + - Crypto.ECC.Curve.Point objects can now be compared with equal(). Regards, -- Peter Bortas

1 0

Pike 8.0.496 release candidate
by Peter Bortas 05 Oct '17

05 Oct '17

Pike 8.0.496 release candidate: https://pike.lysator.liu.se/pub/pike/beta/8.0.496/Pike-v8.0.496.tar.gz Other builds: https://pike.lysator.liu.se/pub/pike/beta/8.0.496/Pike-v8.0.496-Darwin-15.4… https://pike.lysator.liu.se/pub/pike/beta/8.0.496/Pike-v8.0.496-win32-oldli… Changes since last beta is some WhiteFish cleanup and a signal handler fix. Changes since Pike 8.0.466 (release 10) ---------------------------------------------------------------------- New Features ------------ o Crypto.ECC - Added get_point() to Crypto.ECC.Curve. - Crypto.ECC.Curve.Point objects can now be compared with _equal(). o JWK - Added Web.encode_jwk(). - Added jwk() to signatures (Nettle.Sign, Crypo.RSA, Crypto.ECC.Curve.ECDSA) - Added jwk() to Crypto.Hash.HMAC. - decode_jwk() on a ECC private key now returns an ECDSA object (and a Point object for an ECC public key). o Standards.PKCS Support for decoding PKCS #10 public keys through Standard.PKCS.parse_public_key. Bug fixes --------- o Protocols.DNS Added hooks for controlling error handling in Protocols.DNS.server. o Protocols.HTTP Fixed a memory leak in the HTTP header parser upon receiving malformed HTTP headers. o Protocols.WebSocket Fixed a case where the onopen callback would get the wrong argument. o Search Fixes some broken SQL queries causing data corruption. o Sql.sqlite list_fields() now throws an error when used on a non-existent table. o Stdio.Buffer - Some methods (add_int*, input_from, add_padding) did not trigger a call to the fd output function. When using an Stdio.Buffer instance in Stdio.File buffer mode, this could result in new data not being written. - Due to an error in the realloc strategy, in some cases unread() did not succeed after reading or writing data to a fd. o Threads Fixed a race condition when creating a new thread while threads are disabled. o WhiteFish - Fixed issues with merging of empty sets. - Fixed rank calculation on intersection of sets. - Fixed multiple memory leaks. - Improved behavior when provided with corrupted input. - The module is now tested by the normal testsuite. Compiler -------- o Improved syntax error recovery, including eliminating some fatal conditions. o Fixed a memory leak in the preprocessor. Runtime ------- o Fixed NULL-dereference by the gc when running count_memory() --with-dmalloc. o Fixed fatal "Didn't find gc marker as expected" at exit --with-cleanup-on-exit. o Signal handling Fixed an error where processes would share the same queue for pending signals after using fork(). As a result, a signal sent to one process could trigger a signal handler in the other process. Building & Tools ---------------- o Configuration Fixes to the detection of MariaDB, MySQL and Inotify. o mkpackage Fixed issue where the error code from extra platform tests wasn't propagated all the way to exit from the install script.

1 0

Pike 8.0.492 beta/release candidate
by Peter Bortas 03 Oct '17

03 Oct '17

Pike 8.0.492 beta/release candidate: https://pike.lysator.liu.se/pub/pike/beta/8.0.492/Pike-v8.0.492.tar.gz Other builds: https://pike.lysator.liu.se/pub/pike/beta/8.0.492/Pike-v8.0.492-Darwin-15.4… https://pike.lysator.liu.se/pub/pike/beta/8.0.492/Pike-v8.0.492-win32-oldli… I think grubba might want to add something to the CHANGELOG for Search/WhiteFish before we make this a release build? So Bill can maybe hold off on the Mac build until that is cleared up. Changes since Pike 8.0.466 (release 10) ---------------------------------------------------------------------- New Features ------------ o Crypto.ECC - Added get_point() to Crypto.ECC.Curve. - Crypto.ECC.Curve.Point objects can now be compared with _equal(). o JWK - Added Web.encode_jwk(). - Added jwk() to signatures (Nettle.Sign, Crypo.RSA, Crypto.ECC.Curve.ECDSA) - Added jwk() to Crypto.Hash.HMAC. - decode_jwk() on a ECC private key now returns an ECDSA object (and a Point object for an ECC public key). o Standards.PKCS Support for decoding PKCS #10 public keys through Standard.PKCS.parse_public_key. Bug fixes --------- o Protocols.DNS Added hooks for controlling error handling in Protocols.DNS.server. o Protocols.HTTP Fixed a memory leak in the HTTP header parser upon receiving malformed HTTP headers. o Protocols.WebSocket Fixed a case where the onopen callback would get the wrong argument. o Search Fixes some broken SQL queries causing data corruption. o Sql.sqlite list_fields() now throws an error when used on a non-existent table. o Stdio.Buffer - Some methods (add_int*, input_from, add_padding) did not trigger a call to the fd output function. When using an Stdio.Buffer instance in Stdio.File buffer mode, this could result in new data not being written. - Due to an error in the realloc strategy, in some cases unread() did not succeed after reading or writing data to a fd. o Threads Fixed a race condition when creating a new thread while threads are disabled. Compiler -------- o Improved syntax error recovery, including eliminating some fatal conditions. o Fixed a memory leak in the preprocessor. Runtime ------- o Fixed NULL-dereference by the gc when running count_memory() --with-dmalloc. o Fixed fatal "Didn't find gc marker as expected" at exit --with-cleanup-on-exit. Building & Tools ---------------- o Configuration Fixes to the detection of MariaDB, MySQL and Inotify. o mkpackage Fixed issue where the error code from extra platform tests wasn't propagated all the way to exit from the install script. -- Peter Bortas

1 0

Possible issue with elliptic curve crypto?
by Chris Angelico 29 Sep '17

29 Sep '17

I'm far from any sort of crypto expert, but this looks a bit odd. SSL.File() is bombing out when trying to work with ECDHE ciphers. Using this Pike script: object ssl; void readcb(mixed id, string data) {exit(0, "Readable\n%s\n", data);} int x=1; void writecb() {if (x) ssl->write("asdf\n"); x=0; write("Writable\n");} int main() { Stdio.File sock = Stdio.File(); sock->connect("127.0.0.1", 2211); ssl = SSL.File(sock, SSL.Context()); ssl->set_nonblocking(readcb, writecb, lambda() {exit(0, "Closed\n");}); ssl->connect("localhost"); write("Connected\n"); return -1; } Generate a keypair: $ openssl req -x509 -newkey rsa:4096 -keyout server.pem -out cert.pem -days 365 -nodes -subj '/CN=localhost' Start a simple server: $ openssl s_server -port 2211 -cert cert.pem -key server.pem Run the above script. It crashes out: sprintf: Wrong type for argument 3: expected integer, got string. pike/lib/modules/SSL.pmod/Cipher.pmod:1213: SSL.Cipher.KeyExchangeECDHE()->client_key_exchange_packet(_static_modules. _Stdio()->Buffer(0 bytes, read=[..-1] data=[0..-1] free=[0..224] allocated ),771) ... full traceback snipped ... Start the server with ECDH ciphers disabled: $ openssl s_server -port 2211 -cert cert.pem -key server.pem -cipher 'DEFAULT:!ECDH' Run the same script. It succeeds - sends a message to the server, waits for a response, then terminates. There seems to be an issue with the way the premaster_secret is being generated. But a quick hack to change get_x() to get_x_num(), while it prevents the crash, doesn't actually make the connection work. Hoping that someone else actually understands what's going on here! ChrisA

1 0

Update CHANGES
by Peter Bortas 24 Sep '17

24 Sep '17

I note that there has been no edit of CHANGES in 8.0 since the last release was made over a month ago. There have been a number of checkins though, several of them looking like they should have a changelog entry. Please fix. -- Peter Bortas

1 0

Roadtrip through Scandinavia, spontaneous meetup(s)?
by Stephen R. van den Berg 03 Aug '17

03 Aug '17

As it happens, I'm doing a roadtrip (with my wife, and 2 kids (19 and 7)) through Scandinavia right now. Our itinerary is a little bit flexible, we're planning and booking one day ahead, however, it looks like we are going to be in and around the following places in the next few days (actually, these are the places we plan on spending the nights on that day, so we're going to be in that place the following morning until lunch (at least) as well): Fri Aug 4th: Copenhagen Sat Aug 5th: Goteborg Sun Aug 6th: Linkoping Mon Aug 7th: Stockholm Tue Aug 8th: Stockholm Wed Aug 9th: Oslo If any Pikers think it'd be nice to meet up casually for lunch, dinner or just a beer, in and around those dates/cities, drop me a note. Incidentally, I can only read email replies, since the mailinglist gateway is still down (I presume). -- Stephen. <srb(a)cuci.nl>

2 2

Pike 8.0.466 beta/release candidate
by Peter Bortas 03 Aug '17

03 Aug '17

Pike 8.0.466 beta/release candidate: https://pike.lysator.liu.se/pub/pike/beta/8.0.466/Pike-v8.0.466.tar.gz Other builds: https://pike.lysator.liu.se/pub/pike/beta/8.0.466/Pike-v8.0.466-Darwin-15.4… https://pike.lysator.liu.se/pub/pike/beta/8.0.466/Pike-v8.0.466-win32-oldli… Last months release candidate never got promoted to release, so the changes is very similar. Changes since Pike 8.0.438 (release 9) ---------------------------------------------------------------------- New Features ------------ o Concurrent The Concurrent module simplifies asynchronous code by synchronizing events in different ways. As an example the connect() function shown below will respond with a Concurrent.Future object that at some point will represent either a connected socket or a failure. Concurrent.Future connect(string host, int port) { Stdio.File con = Stdio.File(); Concurrent.Promise p = Concurrent.Promise(); if( !con->async_connect(host, port, lambda(int success) { if(success) p->success(con); else p->failure("Failed to connect to "+host+":"+port+"\n"); })) { p->failure("Failed to open socket.\n"); } return p->future(); } The returned future can then be used in various ways. // On success, call make_request(con, query). On failure call // werror(msg). connect(host, port) ->on_failure(werror) ->on_success(make_request, query); // On success, call make_request(con, query1) followed by // make_request(resp, query2), where resp is the return value from // make_reqest. connect(host, port) ->then(make_request, werror, query1) ->then(make_request, werror, query2); // Call bridge_ports(con1, con2) when both connections are // established. Concurrent.all(connect(host1, port1), connect(host2, port2)) ->then(bridge_ports, failure); // Call make_request(con) once either of the connections are // established. Concurrent.race(connect(host1, port1), connect(host2, port2)) ->then(make_requet, query); o Debug.Inspect Allows for interactive debugging and live data structure inspection in both single- and multi-threaded programs. Example: In the program you'd like to inspect, insert the following one-liner: Debug.Inspect("/tmp/test.pike"); Then start the program and keep it running. Next you create a /tmp/test.pike with the following content: void create() { werror("Only once per modification of test.pike\n"); } int main() { werror("This will run every iteration\n"); werror("By returning 1 here, we disable the stacktrace dumps\n"); return 0; } void destroy() { werror("destroy() runs just as often as create()\n"); } Whenever you edit /tmp/test.pike, it will automatically reload the file. Bug fixes --------- o ADT.Heap Fixed heap corruption when the same object is pushed more than once. It will now be considered as calling adjust(). o FSEvents EventStreamMonitor now works with other backends. o Filesystem.Monitor - Reduced initialization latency. - Changed the polling heuristic. This is intended to reduce poll (and notification) delays in some circumstances. - Improved robostness of adjust_monitor(). - Removed some dead and obsolete code. - Scan accelerated monitors too. Both the Inotify and FSEvents APIs claim that they support notifications on eg network file systems, and while they will succeed in notifying on changes performed by the local host on such file systems, they will not on changes performed by other hosts. To avoid missing such changes these monitors need to be actively scanned too. - Fixed lost acceleration with InotifyMonitor Recover from race-condition where when a file was repeatedly created and deleted, acceleration was lost. - Fixed symlink issue with InotifyMonitor. - Added support for more fine-grained tracing of monitors. o Inotify Addressed an issue where the backend might be stuck in pending indefinitely. o mappings Fixed an off by one error in random(mapping) that randomly caused values of type PIKE_T_FREE from the freelist to be exposed to Pike. o Nettle.Hash Fixed NULL-dereference in Nettle.Hash()->crypt_hash(). o Parser.HTML Fixed a condition where Pike would run out of stack space for large documents. o Search Fixed a race condition when updating the database. o Sql.pgsql - Sped up BEGIN/COMMIT statements. - Preserve the initial error message in case of multiple error messages during the same transaction. - Flush out unseen error messages upon connection close to stderr. - Closed a prepared-statement-cache race when the same statement is offered multiple times before it finalises the cache entry. - Fix sync errors with the database in case of multiple running statements on a single connection that generate multiple errors. - Eliminate spurious sync errors on pipe-lined transactions (multiple transactions in flight on a single file descriptor). - CancelRequests (to cancel running queries) caused sync errors with the database when multiple queries were in flight. - Eliminate transient error messages on database restarts. o Sql.SQLite When using query bindings, strings are now always stored as strings; previously, 8-bit strings were stored as binary objects (BLOBs) and wide strings were stored as unicode strings, which caused 8-bit strings to be unequal (and thus not returned) when used in a standard string query. Binary values may be stored as BLOBs using bindings by wrapping the binary string in a multiset. For example, to store the value "myBinary" as a BLOB value using a binding, use: (<"myBinary">). o Standards.BSON - Fixed incorrect encoding/decoding of Binary data. - Bugfixes for the decoding of Binary values of subtype 2, Binary values of subtypes above 0x7f and Datetime values with negative values. o Standards.JSON Fixed integer overflow in decode() on 64-bit platforms. o Stdio.Buffer - Fixed a crash when attempting to create a rewind key on a buffer returned by read_buffer(). - Fixed integer overflow in read_json(). Building -------- o Configure Attempt to detect the tool prefix depending on ABI. Improves detection of pkg-config. o Java Detect system installation of JavaVM framework on MacOS X. o Stdio Improved support for NetBSD. Regards, -- Peter Bortas

2 1

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Pike-devel