Tech Leader 株式会社 LiftBase
Designed and implemented a custom web scraping system using Python and Selenium to automatically collect large-scale, job-related data from multiple social media platforms, enabling the daily collection of hundreds of thousands of records. Applied Natural Language Processing (NLP) techniques including BERT-based embedding models to perform noise reduction and data normalization. Achieved high-accuracy entity resolution by clustering user posts and identifying data from the same individual. Acted as Project Manager, leading a 10-person engineering team in an Agile development environment.