Building Permit Data Pipeline
I was interested in tracking the changes in supply to the real estate market in my area (Dallas,TX). Zero to no experience in CRE, but have been told that there is 100% transparency on supply because building permits are public information. Was wondering if anyone had any previous experience building a CRE data pipeline and any tips they recommend or pitfalls to avoid. After cleaning the data I plan on creating simple predictive models and trend visualizations in python.
[{"id": "f909epg", "text": "Please do it, CRE is severely lacking in functional technology.", "replies": [], "depth": 1}, {"id": "f93549q", "text": "please share your prediction.", "replies": [{"id": "f9fysab", "text": "\"... creating simple predictive models...\"\n\n Doesn't simplicity tend to get complicated? \n\nComputing was simple 50 years ago.  We just didn't know it was complicated.\n\nPredicting is simple.  Just ignore all the instances when you were wrong.\n\nEdit:\n\nLike SF....Lady wrote (below) that project seems to be too much for a one man band.", "replies": [], "depth": 2}], "depth": 1}, {"id": "f94kfq3", "text": "What you are proposing might be more of a big team/department endeavor versus a one-man-band. Dallas (my hometown, FWIW) is literally busting at the seams: \n\nThe Dallas-Fort Worth-Arlington, Texas area gained more new residents in 2018 than any other metro area in the nation, according to recent U.S. Census Bureau data. The city's population, now more than 7.5 million, grew by nearly 132,000 people from 2017 to 2018. Over the past eight years, Dallas-Fort Worth, the fourth-largest metro area in the country, has added more than 1 million people.", "replies": [], "depth": 1}, {"id": "f97iqwa", "text": "I\u2019m in NYC so might be different from your situation but it was a nightmare navigating the department of buildings to find the information I needed for a similar project. Best bet to get all the data is show up at their physical office or talk to someone who has gotten the information you are looking for at scale.", "replies": [{"id": "f9hwcgs", "text": "Nightmare?\nhttps://www1.nyc.gov/assets/buildings/html/nyc-active-major-construction.html", "replies": [{"id": "fa11co0", "text": "Not what I needed, but thanks. I wanted all available info on every commercial building (address, square footage, zoning, etc)  and was looking to join that with all building sales, liens, and permits being pulled. Was able to figure it out but no thanks to anyone working with the city.", "replies": [], "depth": 3}], "depth": 2}], "depth": 1}]