Pike-devel

pike-devel@lists.lysator.liu.se

3041 discussions

Re: Unable to call MySQL stored procedures from Pike v7.6 release 112
by Stephen R. van den Berg 14 Feb '09

14 Feb '09

Kai Voigt wrote: >a stored procedure in MySQL doesn't return anything itself, but it >might include one or more SQL statements which are returned to the >calling client as if those statements would have been called >individually. >Note that you might have to handle multiple statements in a stored >procedure. I see. So I presume that stored procedures in MySQL are not invoked through mere SELECTs? It would imply, though, that if you stick to at most one SELECT resultset in your MySQL stored procedure, then the current Sql interface in Pike will/should suffice. Oracle and PostgreSQL can return at most a single resultset, and are invoked through SELECT normally. -- Sincerely, Stephen R. van den Berg. "<Clarions sounding> *No one* expects the Spanish inquisition!"

1 0

FakeFile() and to assign() or not to assign()
by Stephen R. van den Berg 12 Feb '09

12 Feb '09

Is there a particular reason this doesn't work: Pike v7.8 release 127 running Hilfe v3.5 (Incremental Pike Frontend) > Stdio.FILE in; > (in=Stdio.FILE())->assign(Stdio.FakeFile("foo\nbar\n")); Stdio.File(): not open. /usr/local/pike/7.8.127/lib/modules/Stdio.pmod/module.pmod:1490: Stdio.FILE(0, 0, 777 /* fd=-1 */)->set_read_callback(0) /usr/local/pike/7.8.127/lib/modules/Stdio.pmod/module.pmod:1192: Stdio.FILE(0, 0, 777 /* fd=-1 */)->set_read_callback(0) /usr/local/pike/7.8.127/lib/modules/Stdio.pmod/module.pmod:727: Stdio.FILE(0, 0, 777 /* fd=-1 */)->assign(Stdio.FakeFile(8,"rw")) /usr/local/pike/7.8.127/lib/modules/Stdio.pmod/module.pmod:1776: Stdio.FILE(0, 0, 777 /* fd=-1 */)->assign((a)0=Stdio.FakeFile(8,"rw")) > -- Sincerely, Stephen R. van den Berg. I'm sorry. The number you have reached is imaginary. Please rotate your phone 90 degrees and try again.

2 1

Re: FakeFile() and to assign() or not to assign()
by Stephen R. van den Berg 12 Feb '09

12 Feb '09

Arne Goedeke wrote: >Stephen R. van den Berg wrote: >>> Stdio.FILE in; >>> (in=Stdio.FILE())->assign(Stdio.FakeFile("foo\nbar\n")); >> Stdio.File(): not open. >Not sure what you expect it to do. Stdio.File operates on an fd, >FakeFile does not have any. I think that assign is meant to be used for >Stdio.File subclasses primarily. Well, I'd like to have a FakeFile() with getchar(), gets() and unread(). So I thought, opening a Stdio.FILE() with a FakeFile() as source should do the trick. -- Sincerely, Stephen R. van den Berg. The first 90% of code accounts for the first 90% of development time. The remaining 10% of code accounts for the other 90% of development time.

1 0

Support for array(string|array(int))*string
by Stephen R. van den Berg 12 Feb '09

12 Feb '09

Pike 7.8 currently does: > ({"abc",({65,65,66}),"def"})*"x"; (1) Result: "abcxdef" I have created a patch that makes it do: > ({"abc",({65,65,66}),"def"})*"x"; (1) Result: "abcxAABxdef" instead, and which also throws an error if any other types are inside the array (the old code merely skipped them). I'd consider the second behaviour (after my patch) more desirable and in light of actually throwing errors on unsupported types, it is really is a bugfix. Any objections to this behaviour? -- Sincerely, Stephen R. van den Berg. Auto repair rates: basic labor $40/hour; if you wait, $60; if you watch, $80; if you ask questions, $100; if you help, $120; if you laugh, $140.

8 26

AES pike 7.4 example
by cschalkwijk 10 Feb '09

10 Feb '09

Hi, I need an example for using the AES encryption in pike 7.4. I can't get it to work. Thanks a bunch! -- Met vriendelijke groet / With kind regards / mit besten Grüßen, Coen Schalkwijk Software Engineer coen.schalkwijk(a)rtl.nl <mailto:coen.schalkwijk@rtl.nl> coen(a)rtlinteractief.nl <mailto:coen@rtlinteractief.nl> +31 (0)35 671 8915 __________________________________________________________ Deze e-mail en de inhoud is vertrouwelijk en uitsluitend bestemd voor de geadresseerde(n). Indien u niet de geadresseerde bent van deze e-mail verzoeken wij u dit direct door te geven aan de verzender door middel van een reply e-mail en de ontvangen e-mail uit uw systemen te verwijderen. Als u geen geadresseerde bent, is het niet toegestaan om kennis te nemen van de inhoud, deze te kopieren, te verspreiden, bekend te maken aan derden noch anderszins te gebruiken. The information contained in this e-mail is confidential and may be legally privileged. It is intended solely for the addressee. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. Please notify us immediately if you have received it in error by reply e-mail and then delete this message from your system. __________________________________________________________

2 5

Re: Stdio.exist
by Mirar ＠ Pike developers forum 02 Feb '09

02 Feb '09

(if file_stat finds symlinks, that is.)

7 12

Confusing error message
by Stephen R. van den Berg 02 Feb '09

02 Feb '09

This looks fine: > string a=({"12","34","56"}); Compiler Error: 1: Bad type in assignment. Compiler Error: 1: Expected: string. Compiler Error: 1: Got : array(string(0..255)). This is confusing: > (string)({"12","34","56"}); cast: Item 2 is not an integer: "56" HilfeInput:1: HilfeInput()->___HilfeWrapper() Any ideas on how this last one can be improved? -- Sincerely, Stephen R. van den Berg. E-mails should be like a lady's skirt: Long enough to cover the subject, and short enough to be interesting.

6 6

Stdio.exist
by Martin Stjernholm, Roxen IS ＠ Pike developers forum 01 Feb '09

01 Feb '09

I just noticed that Stdio.exist returns 0 for dangling symlinks. I think that's unfortunate. What do you say, consider it a bug and fix it (with compat goo for #pike 7.6), or document it as intended behavior?

5 17

RFC: New Parser class for parsing structured datafiles (non-XML)
by Stephen R. van den Berg 28 Jan '09

28 Jan '09

I've revamped some datafileparsing routines I've been using for years, and made them more robust/generic in the process. I'd like to include this class into mainstream Pike (7.8 or 7.9) eventually, as Parser.Structure (for lack of a better name) perhaps. The sample records here are: a. Some bank statements in CSV format. b. Some bank statements in MT940 format. Any comments with regard to the provided interface, the datastructure description or the usefulness, or perhaps the superfluousness because this can already be done by Parser.LR and I'm just being silly for not reusing that? With regard to documentation, that will be improved, I know it's a bit scarce at the moment ;-). Sample input: ---------------------cut here------------------------- 1234563,"20081128","IC",00000,8689839,"KN: ARNL-1034758710-","",19.90,"A","M","BETREFT:25399280 ACCESS INTERNET BV","EUR" 2348165,"20081128","DV",00000,0,"DEBETRENTE GIROKWARTAALKREDIET","",10.04,"A","M","PER. 21/10-20/11 (1,15% PER MND)","EUR" 2341864,"20081128","DV",00000,0,"DEBETRENTE 1,39% PER MAAND,","",0.35,"A","M","PERIODE 21/10 - 20/11","EUR" 0000 01PSTBNL21XXXX00001 0000 01PSTBNL21XXXX00001 940 00 :20:MPBZ :25:0003890413 :28C:000 :60F:C071205EUR2085,93 :61:071206C11,90NGT NONREF :86:0001239968 Hr X Colijn LANDGRAAF Hr X Colijn LANDGRAAF 1700.163221231474 TRANSACTIEDATUM: 06-12-2007 :61:071206D109,10NIC 004952732340412 :86:0002243510 KN: 004952739440412 049-8223343 BETREFT FACTUUR D.D. 28-11-2007 INCL. 17,42 BTW KPN Telefonie :61:071206D34,95NDV 4700134832333684 :86:0998234454 KN: 4702162821344484 4700124821134444 R.2003-13224 K.122368 PEDESCO/KLONSSEN.ORG :62F:C081119EUR289,33 :86:D000004C000009D9961,90C60315,92 -XXX ---------------------cut here------------------------- Sample output (corresponds with the above input): ---------------------cut here------------------------- Found record: ([ /* 1 element */ "csv": ([ /* 1 element */ "gtz": ({ /* 3 elements */ ([ /* 11 elements */ "afbij": "A", "amount": "19.90", "bankno": "8689839", "mutatie": "M", "mutatiesoort": "IC", "mybankno": "1234563", "name": "KN: ARNL-1034758710-", "reference": "BETREFT:25399280 ACCESS INTERNET BV", "transferdate": "20081128", "valutacode": "EUR", "volgnummer": "00000" ]), ([ /* 11 elements */ "afbij": "A", "amount": "10.04", "bankno": "0", "mutatie": "M", "mutatiesoort": "DV", "mybankno": "2348165", "name": "DEBETRENTE GIROKWARTAALKREDIET", "reference": "PER. 21/10-20/11 (1,15% PER MND)", "transferdate": "20081128", "valutacode": "EUR", "volgnummer": "00000" ]), ([ /* 11 elements */ "afbij": "A", "amount": "0.35", "bankno": "0", "mutatie": "M", "mutatiesoort": "DV", "mybankno": "2341864", "name": "DEBETRENTE 1,39% PER MAAND,", "reference": "PERIODE 21/10 - 20/11", "transferdate": "20081128", "valutacode": "EUR", "volgnummer": "00000" ]) }) ]) ]) Found record: ([ /* 1 element */ "mt940": ([ /* 11 elements */ "accountno": "0003890413", "closingbalance": ([ /* 4 elements */ "amount": "289,33", "creditdebit": "C", "currency": "EUR", "date": "081119" ]), "creditamount": "60315,92", "creditentries": "000009", "debitamount": "9961,90", "debitentries": "000004", "messageheader1": ({ /* 2 elements */ ([ /* 2 elements */ "exportaddress": "PSTBNL21XXXX", "exportnumber": "00001" ]), ([ /* 2 elements */ "exportaddress": "PSTBNL21XXXX", "exportnumber": "00001" ]) }), "messagetrailer": ([ /* 2 elements */ "end": "XXX", "start": "-" ]), "openingbalance": ([ /* 4 elements */ "amount": "2085,93", "creditdebit": "C", "currency": "EUR", "date": "071205" ]), "reference": "MPBZ", "statements": ({ /* 3 elements */ ([ /* 6 elements */ "amount": "11,90", "creditdebit": "C", "description": "0001239968 Hr X Colijn LANDGRAAF\n" "Hr X Colijn LANDGRAAF 1700.163221231474\n" "TRANSACTIEDATUM: 06-12-2007", "paymentreference": "NONREF", "transactiontype": "GT ", "valuedate": "071206" ]), ([ /* 6 elements */ "amount": "109,10", "creditdebit": "D", "description": "0002243510 KN: 004952739440412\n" "049-8223343 BETREFT FACTUUR D.D. 28-11-2007\n" "INCL. 17,42 BTW KPN Telefonie", "paymentreference": "004952732340412", "transactiontype": "IC ", "valuedate": "071206" ]), ([ /* 6 elements */ "amount": "34,95", "creditdebit": "D", "description": "0998234454 KN: 4702162821344484\n" "4700124821134444 R.2003-13224 K.122368\n" "PEDESCO/KLONSSEN.ORG", "paymentreference": "4700134832333684", "transactiontype": "DV ", "valuedate": "071206" ]) }) ]) ]) ---------------------cut here------------------------- Sample code to actually produce the output: object rf=parsestruct(allformats,Stdio.stdin,1); { mapping m; while(m=rf->fetch()) write("Found record: %O\n",m); } Sample format description needed for parsing the above input: array|mapping allformats= ([ "csv": ({ ({"gtz", ({"mybankno",(<",">)}), ({"transferdate",(<",">)}), ({"mutatiesoort",(<",">)}), ({"volgnummer",(<",">)}), ({"bankno",(<",">)}), ({"name",(<",">)}), ({"kostenplaats",(<",">),(["drop":1])}), ({"amount",(<",">)}), ({"afbij",(<",">)}), ({"mutatie",(<",">)}), ({"reference",(<",">)}), ({"valutacode",(<",">)}), }), }), "mt940": ({ ({"messageheader1", ({"exporttime","0000",(["drop":1])}), ({"CS1"," ",(["drop":1])}), ({"exportday","01",(["drop":1])}), ({"exportaddress",12}), ({"exportnumber",5,(["regex":"[0-9]+"])}), }), ({"messageheader3",(["fold":1]), ({"messagetype","940",(["drop":1])}), ({"CS1"," ",(["drop":1])}), ({"messagepriority","00",(["drop":1])}), }), ({"TRN",(["fold":1]), ({"tag",":20:",(["drop":1])}), ({"reference","GTZPB|MPBZ|INGEB"}), }), ({"accountid",(["fold":1]), ({"tag",":25:",(["drop":1])}), ({"accountno",10}), }), ({"statementno",(["fold":1]), ({"tag",":28C:",(["drop":1])}), ({"settlementno",0,(["drop":1])}), }), ({"openingbalance", ({"tag",":60F:",(["drop":1])}), ({"creditdebit",1}), ({"date",6}), ({"currency","EUR"}), ({"amount",0,(["regex":"[0-9]+,[0-9][0-9]"])}), }), (["statements": ({ ({"statementline",(["fold":1]), ({"tag",":61:",(["drop":1])}), ({"valuedate",6}), ({"creditdebit",1}), ({"amount","[0-9]+,[0-9][0-9]"}), ({"CS1","N",(["drop":1])}), ({"transactiontype",3}), // 3 for Postbank, 4 for ING ({"paymentreference",0}), }), ({"informationtoaccountowner",(["fold":1]), ({"tag",":86:",(["drop":1])}), ({"description","[^\n]+(\n[^:][^\n]*)*"}), }), }), ]), ({"closingbalance",(["mandatory":1]), ({"tag",":62[FM]:",(["drop":1])}), ({"creditdebit",1}), ({"date",6}), ({"currency","EUR"}), ({"amount",0,(["regex":"[0-9]+,[0-9][0-9]"])}), }), ({"informationtoaccountowner",(["fold":1]), ({"tag",":86:",(["drop":1])}), ({"debit","D",(["drop":1])}), ({"debitentries",6}), ({"credit","C",(["drop":1])}), ({"creditentries",6}), ({"debit","D",(["drop":1])}), ({"debitamount","[0-9]+,[0-9][0-9]"}), ({"credit","C",(["drop":1])}), ({"creditamount","[0-9]+,[0-9][0-9]"}), ({"accountname","(\n[^-:][^\n]*)*",(["drop":1])}), }), ({"messagetrailer",(["mandatory":1]), ({"start","-"}), ({"end","XXX"}), }), }), ]); Implementation of the parsestruct class which actually does the parsing according to the specs above: class parsestruct { protected Stdio.FILE in; protected mapping|array fms; protected array(string) alread=({}); protected int eol; protected int maxregexmatch=1024; protected Regexp simple=Regexp("^[^[\\](){}<>^$|+*?\\\\]+$"); protected Regexp emptyline=Regexp("^[ \t\v\r\x1a]*$"); protected mixed severity=1; protected int verb=0; protected int recordcount=0; // verbose is the number of characters to display per progressline protected void create(void|array|mapping formats,void|string|Stdio.File|Stdio.FILE input, void|int verbose) { fms=formats; verb=verbose==1?70:verbose; if(!input) input=""; if(stringp(input)) input=Stdio.FakeFile(input); if(!in->unread) (in=Stdio.FILE())->assign(input); } private string read(int n) { string s; s=in->read(n); alread+=({s}); if(sizeof(s)!=n) throw(severity); return s; } private string gets(int n) { string s; if(n) { s=read(n); if(!s||sizeof(s)!=n||has_value(s,"\n")) throw(severity); } else { s=in->gets(); if(!s) throw(severity); alread+=({s,"\n"}); if(has_suffix(s,"\r")) s=s[..<1]; eol=1; } return s; } protected string getcsvfield(multiset delims) { int leadspace=1,inquotes=0; string c; array word=({}); for(c=read(1);c;) { if(delims[c]) { if(!inquotes) return word*""; word+=({c}); } else switch(c) { case "\"":leadspace=0; if(!inquotes) inquotes=1; else if((c=read(1))=="\"") word+=({c}); else { inquotes=0; continue; } break; default:leadspace=0; case " ":case "\t": if(!leadspace) word+=({c}); break; case "\n": if(!inquotes) { eol=1; return word*""; } word+=({c}); case "\r":case "\x1a":; } c=read(1); } throw(severity); } // "fname", string|regex = regexp match // int|width = field width - 0: till end of line // multiset|delim = delimiters // mapping extra params // array = nested definition/subfields // mandatory = 1 // fold = 1 : makes the record fold its fields into the parent protected mapping getrecord(array fmt,int found) { mapping ret=([]),options; string recname=fmt[0]; if(mappingp(fmt[1])) { options=fmt[1];fmt=fmt[2..]; #if 0 // srb FIXME if(options->mandatory) severity=sprintf("Missing mandatory record %s",recname); #endif } else options=([]),fmt=fmt[1..]; eol=0; foreach(fmt;;array field) { string fname=field[0]; mixed m=field[1]; string|array|mapping value; if(!mappingp(m)) { if(arrayp(m)) { value=getrecord(m,found); m=([]); } else m=([(intp(m)?"width":(stringp(m)?"regex":"delim")):m]); if(sizeof(field)>2) m+=field[2]; } #if 0 // srb FIXME if(!found && m->mandatory) severity=sprintf("Missing mandatory field %s",recname); #endif if(eol) throw(severity); if(!zero_type(m->width)) value=gets(m->width); if(m->delim) { multiset delim=m->delim; if(sizeof(delim-(<",",";","\t"," ">))) { for(value=({});;) { string c; if(!(c=read(1))) throw(severity); if(delim[c]) break; switch(c) { case "\n": throw(severity); default: value+=({c}); case "\r":case "\x1a":; } } value*=""; } else value=getcsvfield(delim); } if(m->regex) { Regexp rgx; if(stringp(m->regex)) { if(!value && simple->match(m->regex)) { m->width=sizeof(m->regex); value=gets(m->width); } m->regex=Regexp("^("+m->regex+")"+(value?"$":"")); } rgx=m->regex; if(value) { if(!rgx->match(value)) throw(severity); } else { string buf=in->read(m->maxregexmatch || maxregexmatch); if(!buf || !(value=rgx->split(buf))) { alread+=({buf}); throw(severity); } in->unread(buf[sizeof(value=value[0])..]); value-="\r"; if(has_suffix(value,"\n")) value=value[..<1]; } } if(!m->drop) ret[fname]=value; } if(!eol && gets(0)!="") throw(severity); severity=1; recordcount++; if(verb) { array s=({recname,"::"}); foreach(ret;string name;string value) if(sizeof(value)) s+=({value,","}); werror("%d %.*s\r",recordcount,verb, replace(s[..<1]*"",({"\n"," "," "}),({""," "," "}))); } return options->fold?ret:([recname:ret]); } private void add2map(mapping res,string name,mixed entry) { mapping|array tm = res[name]; if(tm) { if(mappingp(tm)) tm=({tm,entry}); else tm+=({entry}); res[name]=tm; } else res[name]=entry; } parsestruct feed(string content) { in->unread(content); return this; } int skipemptylines() { string line; int eof=1; while((line=in->gets()) && emptyline->match(line)); if(line) eof=0,in->unread(line+"\n"); return eof; } mapping fetch(void|array|mapping formats) { mapping ret=([]); int skipempty=0; if(!formats) { if(skipemptylines()) return UNDEFINED; skipempty=1;formats=fms; } if(arrayp(formats)) { foreach(formats;;array|mapping fmt) if(arrayp(fmt)) { array alreadold=alread; for(int found=0;;found=1) { alread=({}); mixed err=catch { mapping rec=getrecord(fmt,found); foreach(rec;string name;mixed value) add2map(ret,name,value); alreadold+=alread; continue; }; severity=1; if(err!=1) throw(err); in->unread(alread*""); break; } alread=alreadold; } else if(fmt=fetch(fmt)) ret+=fmt; if(skipempty) skipemptylines(); } else for(int found=1;found;found=0) { foreach(formats;string name;array|mapping subfmt) for(;;) { mapping m=fetch(subfmt); if(m) { found=1;add2map(ret,name,m); continue; } break; } if(skipempty && skipemptylines()) break; } return sizeof(ret) && ret; } } -- Sincerely, Stephen R. van den Berg. "The difficult we do today; the impossible takes a little longer."

2 1

SHA 0 or 1 in pike 7.4
by cschalkwijk 26 Jan '09

26 Jan '09

There is a SHA (or sha) function provided by Pike 7.4 in the Crypto class. But is this SHA-0 or SHA-1? -- Met vriendelijke groet / With kind regards / mit besten Grüßen, Coen Schalkwijk Software Engineer coen.schalkwijk(a)rtl.nl <mailto:coen.schalkwijk@rtl.nl> coen(a)rtlinteractief.nl <mailto:coen@rtlinteractief.nl> +31 (0)35 671 8915 __________________________________________________________ Deze e-mail en de inhoud is vertrouwelijk en uitsluitend bestemd voor de geadresseerde(n). Indien u niet de geadresseerde bent van deze e-mail verzoeken wij u dit direct door te geven aan de verzender door middel van een reply e-mail en de ontvangen e-mail uit uw systemen te verwijderen. Als u geen geadresseerde bent, is het niet toegestaan om kennis te nemen van de inhoud, deze te kopieren, te verspreiden, bekend te maken aan derden noch anderszins te gebruiken. The information contained in this e-mail is confidential and may be legally privileged. It is intended solely for the addressee. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. Please notify us immediately if you have received it in error by reply e-mail and then delete this message from your system. __________________________________________________________

3 2

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Pike-devel