This example shows how to use Akka to get SSL certificate information (i.e. public keys) from a large list of domains.<\/p>\n
To do this, we’ll need to create a buil.sbt that pulls in Akka, a CSV reader, and a solr client (this is where we’ll store the output).<\/p>\n
\nlibraryDependencies += \"com.typesafe.akka\" %% \"akka-actor\" % \"2.2.1\"\nlibraryDependencies += \"commons-net\" % \"commons-net\" % \"3.3\"\nlibraryDependencies += \"com.github.tototoshi\" %% \"scala-csv\" % \"1.3.0\"\nresolvers += \"amateras-repo\" at \"http:\/\/amateras.sourceforge.jp\/mvn\/\"\nlibraryDependencies += \"jp.sf.amateras.solr.scala\" %% \"solr-scala-client\" % \"0.0.12\"\n<\/pre>\nFor this script, we’ll spin up a bunch of worker actors, and a master actor that knows when the script completes. Each time an actor processes a domain, it sends a message to the master, so it can do reference counting.<\/p>\n
To do this, we’ll need a message class (the first message goes from the orchestration function to the actors, and the second from the actors to the ‘master’ actor).<\/p>\n
\nsealed trait Message\ncase class SSLCheck(domain: String) extends Message\ncase class Success() extends Message\n<\/pre>\nNow we can set up the actor system:<\/p>\n
\nobject SSLChecker {\n def main(args: Array[String]) {\n val system = ActorSystem(\"SSLChecker\")\n val nrOfWorkers = 100\n\n val sslRouter = system.actorOf(\n Props(new CertificateChecker())\n .withRouter(\n RoundRobinRouter(nrOfInstances = nrOfWorkers)\n ), name = \"ssl\")\n\n val f = new File(args(0))\n val reader = CSVReader.open(f)\n val domains = reader.iterator.map(\n (x: Seq[String]) => {\n try {\n x(1).trim\n } catch {\n case e: Throwable => {\n \"\"\n }\n }\n }\n ).toList\n\n system.actorOf(\n Props(\n new Master(domains.length)\n ),\n name = \"master\")\n\n domains.foreach((domain) => {\n sslRouter ! SSLCheck(domain)\n })\n }\n}\n<\/pre>\nThe actual work is done within an actor. This gets a connection to Solr, where it writes the results:<\/p>\n
\nclass CertificateChecker() extends Actor {\n val client = new SolrClient(\"http:\/\/localhost:8983\/solr\/ssl_certificates\")\n\n def receive = {\n case SSLCheck(domain) => {\n try {\n val testUrl = \"https:\/\/www.\" + domain\n println(testUrl)\n val url = new URL(testUrl)\n val newConn = url.openConnection\n\n newConn.setConnectTimeout(500)\n newConn.setRequestProperty(\"User-Agent\", \"Mozilla\/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.2) Gecko\/20090729 Firefox\/3.5.2 (.NET CLR 3.5.30729)\");\n\n val conn: HttpsURLConnectionImpl = newConn match {\n case httpsConn: HttpsURLConnectionImpl => httpsConn\n case conn => {\n println(conn.getClass)\n ???\n }\n }\n\n conn.connect()\n\n conn.getContent\n val certs = conn.getServerCertificateChain\n var certIndex = 0\n for (cert <- certs) {\n val result =\n List(\n domain,\n certIndex,\n conn.getCipherSuite,\n cert.hashCode,\n cert.getPublicKey().getAlgorithm,\n cert.getPublicKey().getFormat,\n cert.getSigAlgName,\n cert.getSigAlgOID,\n cert.getIssuerDN,\n cert.getSerialNumber,\n cert.getSubjectDN,\n cert.getVersion,\n cert.getNotAfter,\n cert.getNotBefore,\n cert.getPublicKey.getFormat,\n cert.getPublicKey.getAlgorithm,\n cert.getIssuerDN.getName\n )\n\n certIndex = certIndex + 1\n\n val level = certIndex match {\n case 1 => \"root\"\n case 2 => \"intermediate\"\n case 3 => \"client\"\n case _ => \"unknown\"\n }\n\n client\n .add(\n Map(\n \"domain\"->domain,\n \"level\"->level,\n \"cipherSuite\"->conn.getCipherSuite,\n \"hashCode\"->cert.hashCode,\n \"publicKeyAlgorithm\"->cert.getPublicKey().getAlgorithm,\n \"publicKeyFormat\"->cert.getPublicKey().getFormat,\n \"signatureAlgorithmName\"->cert.getSigAlgName,\n \"signatureAlgorithmOID\"->cert.getSigAlgOID,\n \"issuerDN\"->cert.getIssuerDN,\n \"serialNumber\"->cert.getSerialNumber,\n \"subjectDN\"->cert.getSubjectDN,\n \"subjectName\"->cert.getSubjectDN.getName,\n \"version\"->cert.getVersion,\n \"expirationDate\"->cert.getNotAfter,\n \"effectiveDate\"->cert.getNotBefore,\n \"publicKeyFormat\"->cert.getPublicKey.getFormat,\n \"publicKeyAlgorithm\"->cert.getPublicKey.getAlgorithm,\n \"issuerDNName\"->cert.getIssuerDN.getName\n ))\n }\n\n client.commit\n\n context.system.actorSelection(\"\/user\/master\") ! Success()\n }\n catch {\n case e: Throwable => {\n println(\"Error: \" + e.getMessage)\n context.system.actorSelection(\"\/user\/master\") ! Success()\n }\n }\n }\n case _ => {\n println(\"Unknown message\")\n }\n }\n}\n<\/pre>\nFinally, the master actor just tracks the results and shuts down on completion:<\/p>\n
\nclass Master(totalDomains: Int) extends Actor {\n var counter = 0\n def receive = {\n case Success() => {\n counter += 1\n if(counter == totalDomains) {\n context.system.shutdown\n }\n }\n }\n}\n<\/pre>\n","protected":false},"excerpt":{"rendered":"This example shows how to use Akka to get SSL certificate information (i.e. public keys) from a large list of domains. To do this, we’ll need to create a buil.sbt that pulls in Akka, a CSV reader, and a solr client (this is where we’ll store the output). libraryDependencies += “com.typesafe.akka” %% “akka-actor” % “2.2.1” … <\/p>\n