Senior Market Research Analyst

About the Role

We are seeking a Market Intelligence Analyst with expertise in web crawling, data extraction, and competitive intelligence to join our BI team. In this role, you will design and implement Python-based crawlers to collect, analyze, and derive actionable insights from search engines, social media platforms, app stores, and industry news. Your work will directly support strategic decision-making by monitoring brand sentiment, competitor activities, market trends, and regulatory changes.

Key Responsibilities

Web Crawling & Data Collection

Develop and maintain high-performance Python crawlers (using Selenium, Playwright, Scrapy, BeautifulSoup) to extract structured/unstructured data from:

• Search engines: Negative keywords, brand-related queries
• Social media: KOL lists, KOL posts, post engagement metrics
• App Stores: User reviews and ratings
• News/Forums: Industry trends, competitor announcements, policy updates
• Handle anti-scraping mechanisms and ensure data compliance

Data Processing & Analysis

• Clean and preprocess raw data (e.g., deduplication, text normalization, sentiment tagging)
• Generate structured reports (dashboards/visualizations) to highlight key trends

Competitive & Regulatory Intelligence

• Monitor industry news, policy changes (e.g., fintech regulations), and competitor strategies
• Collaborate with cross-functional teams to align insights with business goals

Qualifications

Must-Have

Technical skills

• Proficient in Python is a must
• Experience with web crawling
• Familiarity with data cleaning

Analytical skills

• Ability to translate raw data into actionable insights
• Strong problem-solving skills and attention to detail
• Basic knowledge of NLP is a plus
• Background in social media analytics is a plus