python - How to monitor the GET methods of a URL? -

-

not sure if i'll make sense or not here goes. in google chrome, if rightclick page , go resources, refresh page, can see get/post methods pop happen. i'm wanting know if there way, in python, input url , have generate list of each call listed (not sure if possible)

would love direction on it!
thanks

i believe can clarify parts of original question.

one 1 hand, using browser-built-in debugging tools investigating how website behaves when loaded browser technique, , not replaceable custom code.

on other hand, looks looking html parser, such beautifulsoup.

also, seem confuse meaning of url , html document. url can point html document, in many cases points other things, such json-api endpoint.

assuming wanted ask how "to input url html document , have generate list of each remote resource call browser perform":

before rendering website, web browser fires off initial http request , retrieves main html document. parses document and, among others, searches further resources retrieved. such resources may css files, javascript files, images, iframes, ... (long list). if finds such resources, browser automatically fires off 1 http request each of these resources. can see, there quite work involved , happening behind scenes, before these requests performed browser.

in python, cannot trivially simulate behavior of browser. can retrieve single html document via urllib or requests module. is, can manually fire off single http request retrieve html document. replicating behavior of browser require

  • to parse html document in same way browser does,
  • to search document remote sources such images, css files, ....,
  • to decide remote resources query in order, and
  • then fire off more http requests, , possibly recursively repeat entire process (as required iframes)

exact replication of browser behavior complex. building proper web browser inherently difficult task.

that is, if want understand behavior of website within browser, use browser's debugging tools.


Comments

Post a Comment

Popular posts from this blog

java - Oracle EBS .ClassNotFoundException: oracle.apps.fnd.formsClient.FormsLauncher.class ERROR -

-
i need in configuring java on machine because, when try loading forms, loader goes in circles , gives error: java.lang.classnotfoundexception: oracle.apps.fnd.formsclient.formslauncher.class @ sun.plugin2.applet.applet2classloader.findclass(unknown source) @ sun.plugin2.applet.plugin2classloader.loadclass0(unknown source) @ sun.plugin2.applet.plugin2classloader.loadclass(unknown source) @ sun.plugin2.applet.plugin2classloader.loadclass(unknown source) @ java.lang.classloader.loadclass(unknown source) @ sun.plugin2.applet.plugin2classloader.loadcode(unknown source) @ sun.plugin2.applet.plugin2manager.createapplet(unknown source) @ sun.plugin2.applet.plugin2manager$appletexecutionrunnable.run (unknown source) @ java.lang.thread.run(unknown source) i have tried re-installing firefox, older versions of java runtime environments, disabling proxy. what missing? application working on other machines. i spent around 100 hours finding s
Read more

c# - how to use buttonedit in devexpress gridcontrol -

-
Image
i trying create gridcontrol buttonedit in 1 of columns. when user clicks button edit, popups form select product. when selection done on popup, returns datarow selection main grid below. but when column loses focus, value wrote column disappear. here code creates gridcontrol's data , buttonedit's click event. private void frmsiparisnew_load(object sender, eventargs e) { dt = new datatable(); dt.columns.add("malzeme_kodu",typeof(string)); dt.columns.add("malzeme_aciklama", typeof(string)); dt.columns.add("adet", typeof(decimal)); dt.columns.add("birim", typeof(string)); dt.columns.add("fiyat", typeof(decimal)); dt.columns.add("kur", typeof(string)); dt.columns.add("tutar", typeof(decimal)); datarow dr = dt.newrow(); dt.rows.add(dr); gc.datasource = dt; } private void repositoryitembuttoneditmal
Read more

nvd3.js - angularjs-nvd3-directives setting color in legend as well as in chart elements -

-
good morning i using angularjs-nvd3-directives, great, having difficulties when setting color of multi bar chart ( http://cmaurer.github.io/angularjs-nvd3-directives/multi.bar.chart.html ). the show legend works well: <div ng-controller="examplectrl"> <nvd3-multi-bar-chart data="exampledata" id="showlegendexample" width="550" height="300" showxaxis="true" showyaxis="true" xaxistickformat="xaxistickformatfunction()" showlegend="true"> <svg></svg> </nvd3-multi-bar-chart> </div> but when add option in conjunction color="colorfunction()" where, var colorarray = ['#ff0000', '#0000ff', '#ffff00', '#00ffff']; $scope.colorfunction = function() { return function(d, i) { return colorarray[i]; }; } the color of cha
Read more