mechanize for java

mechanize is a stateful HTTP client library (RESTful) with support for HTML, JSON, and (soon) XML web services. mechanize can scrape HTML, crawl web pages, and use JSON and XML web services. This implementation of mechanize is written in Java to be available on the JVM, and specifically compatible with Android. It utilizes HttpClient for HTTP handling. Because mechanize is stateful and allow inspection of web resources, it naturally support GET-then-POST semantics.

• Project Home Page: http://gistlabs.com/software/mechanize-for-java/
• GitHub: https://github.com/GistLabs/mechanize
• Jenkins CI: https://gistlabs.ci.cloudbees.com/job/mechanize/
• License: MPL 2.0

Here is a sample testcase showing mechanize at work with HTML:

	@Test public void testGooglePageSearchForm() {
		MechanizeAgent agent = new MechanizeAgent();
		Document page = agent.get("http://www.google.com");
		Form form = page.form("f");
		form.get("q").set("mechanize java");
		Resource response = form.submit();
		assertTrue(response.getTitle().startsWith("mechanize java"));
	}

Here is a sample testcase showing mechanize using a Google JSON web service:

	@Test
	public void testGoogleApi() throws JSONException {
		MechanizeAgent agent = new MechanizeAgent();
		JsonDocument json = agent.doRequest(googleUrl).add("shortUrl", shortUrl).add("projection", "FULL").get();

		assertEquals(longUrl, json.getRoot().find("longUrl").getValue());

		String value = json.getRoot().find("analytics month countries#US count").getValue();
		assertTrue(value, Integer.valueOf(value)>=1);
	}

What to expect from near future development: #28 Caching and Conditional GETs, #61 XML Support

Release log:

• 0.11.0 on Nov 12th, 2012. Support for Request Headers, Cache and Conditional loading, and chained filters. See https://github.com/GistLabs/mechanize/issues?milestone=8&state=closed
• 0.10.0 on Oct 22nd, 2012. Support for Android, JSON, and CSS Selectors (even for JSON). See https://github.com/GistLabs/mechanize/issues?milestone=7&page=1&state=closed
• 0.9.1 on Oct 3rd, 2012. See https://github.com/GistLabs/mechanize/issues?milestone=6&state=closed for list of resolved issues.
• 0.9.0 on Sept 28th, 2012. See https://github.com/GistLabs/mechanize/issues?milestone=2&page=1&state=closed for list of resolved issues.
• 0.8.0 on Sept 20th, 2012.

Download the code from https://github.com/GistLabs/mechanize/downloads, or use a Maven repository client:

  <dependency>
    <groupId>com.gistlabs</groupId>
    <artifactId>mechanize</artifactId>
    <version>0.11.0</version>
  </dependency>

See the Mechanize Wiki for more details!