Search Jobs

Job description:

Data Pipeline

• Build the Discover module’s data backbone, including data ingestion from open data, subscriptions, and listeners into a managed lakehouse using Azure data services (Microsoft Fabric and/or Azure Data Factory, ADLS).
• Develop and maintain scalable data ingestion pipelines.

Lakehouse

• Model and transform data through Bronze, Silver, and Gold layers.
• Ensure data quality, freshness, and incremental data loads.

Analytics

• Implement signal scoring and analytical queries to transform raw market data into ranked opportunities.

Full-Stack Development

• Build analytics-facing interfaces, including Command Centre views, dashboards, and persona-specific reporting using React, Next.js, TypeScript, and Node.js.
• Integrate front-end applications with the platform’s data services.

Search & AI Integration

• Implement and maintain the vector and search layer using Azure AI Search to support retrieval for the platform’s AI agents.
• Collaborate with the AI Engineer on search and retrieval capabilities.

Data Management & Documentation

• Maintain clear separation between analytical and operational data paths.
• Ensure data models are portable, scalable, and well documented.

Qualifications:

• Bachelor’s Degree in Computer Science, Information Technology, Software Engineering, Data Science, or a related field.
• Minimum 3 years of relevant experience in Full-Stack Development, Data Engineering, or Data Analytics.
• Full-stack development experience using React, Next.js, TypeScript, and Node.js.
• Strong SQL and data modelling skills with experience building ETL/ELT pipelines and working with a lakehouse or data warehouse.
• Proficient in Python for data-related development.
• Experience with Microsoft Azure data services, including Microsoft Fabric, Azure Data Factory, and Azure Data Lake Storage (ADLS).
• Able to manage data quality, incremental loading, schema evolution, and pipeline reliability.
• Fluent with AI-assisted development.
• Experience with Synapse, Databricks, dbt, Parquet, DuckDB, Azure AI Search, vector search, Retrieval-Augmented Generation (RAG) pipelines, or Microsoft Purview will be an added advantage.

Why is This a Great Opportunity:

• Exposure to End-to-End Modern Data ArchitectureThis role offers hands-on involvement in building a complete data ecosystem, from ingestion pipelines to lakehouse architecture, providing valuable experience in managing large-scale data infrastructure using advanced Azure technologies.
• Opportunity to Work with Cutting-Edge AI TechnologiesThe position includes exposure to AI-driven solutions such as Azure AI Search, vector search, and Retrieval-Augmented Generation (RAG), allowing strong career development in rapidly growing AI and machine learning domains.
• Broad Technical Skill Enhancement Across Multiple DisciplinesThe role combines Data Engineering, Analytics, Full-Stack Development, and AI integration, creating an excellent opportunity to strengthen cross-functional technical expertise and expand career versatility.
• High Business Impact Through Data-Driven Decision MakingResponsibilities directly contribute to transforming raw market data into actionable insights and ranked opportunities, enabling meaningful impact on strategic business decisions and platform growth.
• Strong Career Growth in a Future-Focused Technology Environment
  Working with modern tools such as React, Next.js, Microsoft Fabric, Azure Data Factory, and scalable cloud infrastructure provides strong long-term career value in high-demand technology sectors.