Senior Data Engineer

4 weeks ago

Thrissur, India American Inference Full time

Note: Please apply directly through LinkedIn for this position. We kindly request that candidates refrain from contacting company officials via email or messages regarding this role. About the Company We are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines: - Consulting Services: AI Strategy, Automation, and Digital Transformation for enterprises. - SaaS Platform Development: Building a business application suite similar to Odoo and Zoho that is AI-native and user friendly. - Data Lakehouse Solutions: Unified data pipelines for aggregation, cleaning, governance, and advanced analytics. - Government Contracting: Developing secure, compliant AI solutions for the public sector. Our tech stack includes Python, TypeScript, React, Next.js, Go, Rust, Azure, Kubernetes, Spark, MLflow, Postgres, graph databases, and vector stores. We're a small, fast-moving team delivering enterprise-grade solutions with startup agility. Role Overview You will design, build, and optimize data lakehouse solutions, enabling analytics, AI, and MLOps across multiple clients. Key Responsibilities - Design lakehouse architectures (Bronze/Silver/Gold) using Azure Databricks, Delta Lake, or Iceberg - Build scalable PySpark pipelines for batch and streaming data - Implement data quality, validation, and lineage tracking - Integrate pipelines with MLflow for experiment tracking - Optimize Spark performance and cloud cost - Ensure data governance, PII protection, and security compliance - Mentor developers and document patterns and runbooks Required Skills - Apache Spark (PySpark) and SQL (complex joins, CTEs, optimization) - Delta Lake / Iceberg and Azure Data Stack (ADLS, Synapse, Databricks) - MLflow integration for MLOps pipelines - Kafka / Event Hubs for streaming data - Strong Python and data modeling (dimensional, Data Vault) - 5+ years hands-on in data engineering with production-grade systems Nice to Have - Vector databases, dbt, Airflow, Terraform, FinOps exposure, and Great Expectations data validation - Experience with data governance technologies (such as MS Purview or similar) - Certifications: Azure Data Engineer / Databricks DE Education - UG: B.Tech / B.E. – Computer Science / Information Technology - PG: M.Tech / M.E. / Any Postgraduate (preferred) Why Join Us - Impact: You'll have significant influence over our data architecture and enable AI/ML capabilities across the organization. - Growth: Help shape and build our data-driven culture from the ground up. - Learning: Work with the latest in AI, code, and data technologies. - Culture: Flat hierarchy, collaborative, and outcome-driven team.

  • Transformative Data Engineer

    1 week ago

    thrissur, India beBeeDataEngineer Full time

    Senior Data Engineer Job DescriptionHiring for a Senior Data Engineer to join our team. This role emphasizes hands-on development, reliability, and team collaboration.We are seeking an experienced Senior Data Engineer who will contribute to the design and development of data systems including pipelines, APIs, analytics, AI, and machine learning at scale.

  • Data Engineering Expert

    3 days ago

    thrissur, India beBeeData Full time

    **Job Description**As a senior data engineer, you will be responsible for designing, building, and optimizing data lakehouse solutions to enable analytics, AI, and MLOps across multiple clients. Your expertise in architecting scalable data pipelines will help our organization make informed decisions and stay ahead of the competition.**Required Skills and...

  • Senior Data Engineering Professional

    1 week ago

    thrissur, India beBeeDataEngineer Full time

    Data Engineer PositionOur organization seeks a seasoned Data Engineer to spearhead a long-term project initiative.Palantir Foundry / Workshop experience is required.The ideal candidate will possess 3+ years of experience as a Data Engineer with expertise in PySpark and TypeScript.This role involves bringing data engineering prowess to a greenfield multi-year...

  • Senior Data Engineer

    1 week ago

    Thrissur, India RK HR Management Private Limited Full time

    Key Responsibilities:Design and build scalable data pipeline architecture that can handle large volumes of dataDevelop ELT/ETL pipelines to extract, load and transform data from various sources into our data warehouseOptimize and maintain the data infrastructure to ensure high availability and performanceCollaborate with data scientists and analysts to...

  • Highly Skilled Data Engineering Professional

    1 week ago

    thrissur, India beBeeDataEngineer Full time

    Senior Oracle Data Engineer Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for architecting robust data pipelines across on-prem and cloud Oracle ecosystems.Key Responsibilities:Design, develop, and optimize ETL/ELT data pipelines using Oracle Data...

  • Oracle Data Engineer

    1 week ago

    thrissur, India beBeeDataEngineering Full time

    Senior Data Engineering RoleThis key position involves architecting robust data pipelines across on-prem and cloud environments, leveraging expertise in ETL and ELT frameworks to drive scalable data processing.Design, Develop, and Optimize ETL/ELT Pipelines: Utilize Oracle Data Integrator (ODI) to design, develop, and optimize ETL/ELT data pipelines for...

  • Senior Cloud Data Architect

    1 week ago

    thrissur, India beBeeData Full time

    Key Roles and ResponsibilitiesThe ideal candidate will be responsible for designing, implementing, and maintaining robust and scalable data architectures that align with our business objectives.Develop and implement end-to-end data solutions using modern cloud-based platforms, such as Microsoft Fabric and Azure Synapse Analytics.Lead the planning, execution,...

  • Senior Data Solutions Specialist

    6 days ago

    thrissur, India beBeeDataarchitect Full time

    Senior Data ArchitectSimplify, integrate, and comply technology stacks with our team's expertise. We help customers save time and money as they move from strategic Clinical & Quality management to widespread commercialization.Job OverviewLead solution design and delivery for data, analytics, and AI programs across Clinical, Commercial, and Medical Affairs...

  • Senior Data Engineering Expert

    1 week ago

    thrissur, India beBeeDataEngineer Full time

    We are seeking a seasoned professional to spearhead our data engineering efforts.

  • Experienced Senior Data Architect Specialist

    1 week ago

    thrissur, India beBeeSeniorDataEngineer Full time

    Data Engineering ExcellenceAbout the RoleWe're seeking an accomplished Senior Data Engineer with expertise in Power BI to join our data and analytics team. This role plays a crucial part in developing and enhancing our dimensional data models, supporting key financial reporting and analytics across the business.You'll work closely with stakeholders to...