Senior data engineer

2 days ago

Kozhikode, India American Inference Full time

About the Company We are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines: Consulting Services: AI Strategy, Automation, and Digital Transformation for enterprises. Saa S Platform Development: Building a business application suite similar to Odoo and Zoho that is AI-native and user friendly. Data Lakehouse Solutions: Unified data pipelines for aggregation, cleaning, governance, and advanced analytics. Government Contracting: Developing secure, compliant AI solutions for the public sector. Our tech stack includes Python, Type Script, React, Next.js, Go, Rust, Azure, Kubernetes, Spark, MLflow, Postgres, graph databases, and vector stores. We're a small, fast-moving team delivering enterprise-grade solutions with startup agility. Role Overview You will design, build, and optimize data lakehouse solutions, enabling analytics, AI, and MLOps across multiple clients. Key Responsibilities Design lakehouse architectures (Bronze/Silver/Gold) using Azure Databricks, Delta Lake, or Iceberg Build scalable Py Spark pipelines for batch and streaming data Implement data quality, validation, and lineage tracking Integrate pipelines with MLflow for experiment tracking Optimize Spark performance and cloud cost Ensure data governance, PII protection, and security compliance Mentor developers and document patterns and runbooks Required Skills Apache Spark (Py Spark) and SQL (complex joins, CTEs, optimization) Delta Lake / Iceberg and Azure Data Stack (ADLS, Synapse, Databricks) MLflow integration for MLOps pipelines Kafka / Event Hubs for streaming data Strong Python and data modeling (dimensional, Data Vault) 5+ years hands-on in data engineering with production-grade systems Nice to Have Vector databases, dbt, Airflow, Terraform, Fin Ops exposure, and Great Expectations data validation Experience with data governance technologies (such as MS Purview or similar) Certifications: Azure Data Engineer / Databricks DE Education UG: B. Tech / B. E. – Computer Science / Information Technology PG: M. Tech / M. E. / Any Postgraduate (preferred) Why Join Us Impact: You'll have significant influence over our data architecture and enable AI/ML capabilities across the organization. Growth: Help shape and build our data-driven culture from the ground up. Learning: Work with the latest in AI, code, and data technologies. Culture: Flat hierarchy, collaborative, and outcome-driven team.

  • Senior Data Engineer

    3 weeks ago

    Kozhikode, India Whatjobs IN C2 Full time

    Profile name- Senior Data Infrastructure Engineer - Apache Spark & Kubernetes Experience - 5 Years Mode- Remote Required Qualifications - Minimum 5 years of experience in Data Engineering or Infrastructure roles. - Proven hands-on experience with Apache Spark in production. - Deep expertise in Kubernetes architecture and operations. - Strong experience with...

  • Senior Data Engineer

    3 weeks ago

    Kozhikode, India Whatjobs IN C2 Full time

    About the role: We are looking for a strong Data Architect to join our engineering team, focusing on leveraging Azure SQL, Cosmos DB and DataBricks to meet our growing data demands. As a Data Leader in the Apex organization, you will own, develop, and oversee the data capabilities powering customer-facing applications used by hundredsof thousands of...

  • Azure Data Engineer

    5 days ago

    Kozhikode, India Whatjobs IN C2 Full time

    Greetings From TCS! Azure Senior Data Engineers 5 to 10 years PAN INDIA Interview Date: Weekend Virtual Drive 15-Nov-25 Last Date of form submission: Today/ASAP Extensive coding experience (3+ years) including Python/Pyspark (1 years +) Experience developing in Azure with key data technologies (e.G. ADLS, ADF, Azure Databricks etc.) Software development...

  • Senior Software Engineer

    2 weeks ago

    Kozhikode, India Vonnue Full time

    Company DescriptionVonnue aims to revolutionize the software development lifecycle by fostering innovative solutions and driving positive social impact. We partner with forward-thinking organizations to deliver creative visions through disruptive technologies. Alongside software development, we offer network monitoring and cloud solutions that continuously...

  • Senior Data Analyst

    20 hours ago

    Kozhikode, India Whatjobs IN C2 Full time

    At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new...

  • Senior Civil Engineer

    1 week ago

    Kozhikode, Kerala, India Era Creatio Developers LLP Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Company DescriptionEstablished in 2018, Era Creatio Developers LLP is a top player in the Builders & Developers category in Kerala. Based in Kuttikattor, Era Creatio Developers is also a leading home designers and architectural company. We provide the best Kerala home designs by analyzing client requirements, budget, and landscape. Our focus is on delivering...

  • Senior Data Analytics Faculty

    1 week ago

    Kozhikode, Kerala, India BEAT Educations Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job Title:Senior Data Analytics FacultyLocation:PerinthalmannaOrganization:BEAT Edu Center of ExcellenceJob OverviewBEAT Edu Center of Excellence is looking for an experiencedSenior Data Analytics Facultyto join our team in Perinthalmanna. The ideal candidate will have strong expertise in data analytics, hands-on experience with industry tools, and a passion...

  • Senior Data Analyst

    4 weeks ago

    Kozhikode, India Appfabs Incorporation Full time

    We are looking for a versatile and highly skilled Data Analyst / AI Engineer (Immediate Joiner) to join our innovative team. This unique role combines the strengths of a data scientist with the capabilities of an AI engineer, allowing you to dive deep into data, extract meaningful insights, and then build and deploy cutting-edge Machine Learning, Deep...

  • Senior Data Analytics Faculty

    8 hours ago

    Kozhikode, Kerala, India Beat Center of Excellence Full time ₹ 24,00,000 - ₹ 48,00,000 per year

    Job Title: Senior Data Science FacultyLocation: Calicut, KeralaCompany: BEAT EducationsJob Type: Full-time | On-siteAbout BEAT EducationsBEAT Educations is a premier center of excellence committed to providing industry-relevant training and upskilling programs in emerging technologies. We are expanding our academic team and seeking a highly qualified Senior...

  • Senior Customer Support Engineer

    1 week ago

    Kozhikode, India StitchFin Full time

    About UsStitchFin is an innovative startup revolutionizing the healthcare space by building cutting-edge AI solutions. We’re building next-generation healthcare automation powered by AI. Our platform helps health systems streamline operations, reduce administrative overhead, and improve patient financial experiences. As we scale, we’re expanding our team...