Let’s face it. Web scraping can be a bit boring sometimes. The general process is: Find site that has data Inspect element and see where data lives If in html table, write logic to parse table run for one page run on all pages fix minor bugs done Each and every site has little quirks.… Read More How to Turn Web Scraping Into a Computer Vision Problem
Not long ago, Quantopian allowed you to live trade algorithms developed with their software. Sadly they no longer let you do that. It was a painful process but I’ve figured out how to use Interactive Brokers API to create an algorithmic trading bot and run it on a server. In this post I’ll cover how… Read More How to Create an Algo Trading Bot
When I first made a chatbot, I wanted to communicate to it by texting. First thing I did was google “texting python” and a bunch of articles using Twilio came up. I was so excited that Twilio was well documented and easy to set up. But after a year they booted my free account. So… Read More Texting Without Twilio
Earlier today there was a issue with Amazon’s promo code system that caused Amazon Echo’s to be free for Prime customers. Amazon Echo Dot for FREE!!!!! Go all the way to checkout to see a $50 Audible credit applied – obviously price errorhttps://t.co/ap18baZWJy pic.twitter.com/qKBM3lpX43 — IGN Deals (@IGNDeals) August 18, 2017 Like we did with… Read More Automated Amazon Purchasing
There used to be working code out there to scrape sites such as Draft Kings. At least, back before Draft Kings changed it’s terms of use to specifically forbid automated scraping of it’s content. Here, I’m sharing how you can automatically download contest data from Draft Kings. How to do it Draft Kings protects it’s… Read More Scraping Draft Kings Contests
Every fantasy football manager wants to know what rookie will lead the league in scoring. Is the SEC always over hyped? Does a wide receiver with a fast forty in the NFL combine mean anything? As you’ll see, being the best in an event doesn’t mean much. Looking at the NFL Combine Data I’ve scraped… Read More The NFL Combine’s Impact on Rookie Fantasy Performance
This guide is to help you understand where to find data on sports, especially free sports data. Most of it requires coding so I’m working on creating a data scraping guide too. To skip all this work, sign up at Sports Data Direct and let them deal with getting the data for you. Contents MLB Data The… Read More The Guide to Sports Data
With the all star break upon us, I wanted to see how team records at the all star break compare to full season performance. The Chicago Cubs sit below .500 with a 43-45 record (.489) and as a White Sox Fan I get giddy at the prospect of them not doing well again. Last season… Read More Are the Cubs Bad Again? Visualizing MLB Team Records at the All Star Break
Last week, I wrote about using the Google Maps API to visualize travel times according to when you want to leave by using their “Depart at” feature to simulate traffic. This week I took it a step further and made an interactive version. Go give it a try next time you have to drive somewhere, especially… Read More Visualization Vednesday: Travel Times Interactive Version
Algorithmia was recently in the news for receiving Series A funding from Google. The concept is pretty cool. Create a marketplace for machine learning algorithms that allows companies without a large R&D team to use algorithms as a black box. Algorithmia: How it works I created an account and was given “credits” to call algorithms.… Read More Algorithmia for Lolcat OCR Review