Okay, nobody laugh when they read my "code" below. Okay?
I need a guru's help here. It took me seven hours to get where I'm at, and it's about the sloppiest thing you'll ever see. I have NO programming experience, and I know no languages. Now, on with it...
I will include all the parts of "code" I'm using, in the proper order, at the end...
I've set up a wap site (on my home fedora box) for my mobile phone, and I'm trying to incorporate a page that looks up phone numbers from dexonline.com and strips all the html formatting, leaving only the actual search results in a .inc file which is then included in the resulting wap page. What I'm doing is this...
First, I read three inputs from the wap page, name, city, and state. I couldn't figure out how to pass these into bash (or anything else), so what I did was set up a link on the page that incorporates the variables (client side) into the URL of the link and requests it from my webserver. I'm using a "template" URL to dexonline, into which I stick the three variables. But first, I request it form my server, and then I read the URL out of my servers access log. To do this, I have to have the phone request the bad URL, arrive at the "Not Found" page, and then go back to the previous page to continue on to the results page. The results page contains an exec cmd which initiates the whole process after the URL is created. This (sadly) was the only way I could get the URL with the variables out of the wap page and into a bash environment to be used next.
Next, after grepping the URL out of the access log and stripping it of the non-URL stuff (time stamp, etc) and inserting the remaining dexonline stuff, I output the address to a file (called address) and cat it in a for loop to get it into a bash variable so I can then use wget to DL the page and save it as phone.html on my server.
Still with me? Sorry...
Okay, next I grep through the phone.html page for the results (which relies entirely on the format of dexonline's page remaining the same) by keying off of some formatting common only to the actual results. I then pipe these to sed, remove and replace some formatting so it complies with wml, and output it to the .inc file onthe server, which gets called from the wap results page.
Good grief, huh?
Okay, here's the wml code and the phonesearch "script" that is executed...
search.wml
Code:
<?xml version="1.0"?>
<!DOCTYPE wml PUBLIC "-//WAPFORUM//DTD WML 1.1//EN"
"http://www.wapforum.org/DTD/wml_1.1.xml">
<wml>
<head>
<meta forua="true" http-equiv="Cache-Control" content="max-age=0"/>
</head>
<card title="Phone_Search">
<p>
Enter info, then click LOAD<br/>
Page will say Not Found,<br/>
Click Back, then click<br/>
SHOW RESULTS<br/>
</p>
<p>
Find: <input name="find" type="text"/><br/>
City: <input name="city" type="text"/><br/>
State: <input name="state" type="text"/>
</p>
<p>
<anchor title="go">
LOAD
<go href="http://theblumls.com/servlet/ActionServlet;?pid=blistings&queryType=&centerCity=&centerState=&centerLabel=Last&PREVIOUS_PAGE=bsearch&from=&queryText=$(find)&distance=10&centerAddress=Enter+street+address&cityText=$(city)&state=$(state)&surroundingAreas=true"/>
</anchor>
</p>
<p>
<a href="/files/wait.wml">SHOW RESULTS</a>
<br/>
<a href="/files/wapmain.wml">Main</a>
</p>
</card>
</wml>
/bin/phonesearch
Code:
#!/bin/bash
sudo tail -n 20 /var/log/httpd/access_log | grep servlet | sed 's/.*GET/http\:\/\/dexonline.com/' | sed 's/HTTP\/1.1\"\ 404\ 573//' | sed 's/\ //g' > /var/www/html/files/address;
j=1; for i in $(cat /var/www/html/files/address); do address=$i; wget -o /var/www/html/wget_log_phonesearch -O /var/www/html/files/phone.html -r $i; j=$(($j+1)); done;
grep -m 1 listingname /var/www/html/files/phone.html | sed 's/<span\ class=\"listingname\">//' | sed 's/<\/span>/<br\/>/' > /var/www/html/files/results.inc;grep -m 30 -A 10 '<tr><td> </td></tr>' /var/www/html/files/phone.html | grep -B 3 '<b>' | sed 's/<br/<br\//g' | sed 's/--/<br\/>/g' | sed 's/&\ //g' >> /var/www/html/files/results.inc;
results.wml
Code:
<?xml version="1.0"?>
<!DOCTYPE wml PUBLIC "-//WAPFORUM//DTD WML 1.1//EN"
"http://www.wapforum.org/DTD/wml_1.1.xml">
<wml>
<head>
<meta forua="true" http-equiv="Cache-Control" content="max-age=0"/>
</head>
<card id="results" title="results">
<p>
<!--#include virtual="/files/results.inc" -->
</p>
</card>
"http://www.wapforum.org/DTD/wml_1.1.xml">
<wml>
<head>
<meta forua="true" http-equiv="Cache-Control" content="max-age=0"/>
</head>
<card id="results" title="results">
<p>
<!--#include virtual="/files/results.inc" -->
</p>
</card>
</wml>
This works so far, but there's a few issues:
1) as I said, completely dependant on dexonline's html formatting, but I see no way around that
2) I can only return the results from the first page without performing all the tasks over again, which would get to be a bit much
3) HATE that I have to request the bad URL first, then go back a page before continuing to results
4) there's room for problems, like when I tail the access log. If a bunch of pages from the webserver were requested at the same time, the tail might not catch the bad URL since it only goes back 4 lines, but if I go too many lines back it may catch more than one previous search URL if they've been done close together
5) There's almost always duplicate results, which gets annoying
6) Due to the formatting of the phone.html opage, I can't get the name of each resutl to display above it. I can only get the first one. Not good if a return doens't actually match what I searched
7) It kills me to know that there's got to be a MUCH simpler way to do this, I just don't have the experience...
I know, what a hack job, right? Ugh.
If anybody wants/needs to get at the wap site to test it, it's at
http://theblumls.com/files/search.wml
So, can anybody help put this in a nice little package for me, and/or help with some if the remaining issues? Sorry to be so long here...
Thanks in advance,
Jeff
