Senior Data Engineer

3 days ago

Kollam, India American Inference Full time

Note: Please apply directly through for this position. We kindly request that candidates refrain from contacting company officials via email or messages regarding this role. About the Company We are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines: - Consulting Services: AI Strategy, Automation, and Digital Transformation for enterprises. - SaaS Platform Development: Building a business application suite similar to Odoo and Zoho that is AI-native and user friendly. - Data Lakehouse Solutions: Unified data pipelines for aggregation, cleaning, governance, and advanced analytics. - Government Contracting: Developing secure, compliant AI solutions for the public sector. Our tech stack includes Python, TypeScript, React, Next.js, Go, Rust, Azure, Kubernetes, Spark, MLflow, Postgres, graph databases, and vector stores. We're a small, fast-moving team delivering enterprise-grade solutions with startup agility. Role Overview You will design, build, and optimize data lakehouse solutions, enabling analytics, AI, and MLOps across multiple clients. Key Responsibilities - Design lakehouse architectures (Bronze/Silver/Gold) using Azure Databricks, Delta Lake, or Iceberg - Build scalable PySpark pipelines for batch and streaming data - Implement data quality, validation, and lineage tracking - Integrate pipelines with MLflow for experiment tracking - Optimize Spark performance and cloud cost - Ensure data governance, PII protection, and security compliance - Mentor developers and document patterns and runbooks Required Skills - Apache Spark (PySpark) and SQL (complex joins, CTEs, optimization) - Delta Lake / Iceberg and Azure Data Stack (ADLS, Synapse, Databricks) - MLflow integration for MLOps pipelines - Kafka / Event Hubs for streaming data - Strong Python and data modeling (dimensional, Data Vault) - 5+ years hands-on in data engineering with production-grade systems Nice to Have - Vector databases, dbt, Airflow, Terraform, FinOps exposure, and Great Expectations data validation - Experience with data governance technologies (such as MS Purview or similar) - Certifications: Azure Data Engineer / Databricks DE Education - UG: B.Tech / B.E. – Computer Science / Information Technology - PG: M.Tech / M.E. / Any Postgraduate (preferred) Why Join Us - Impact: You'll have significant influence over our data architecture and enable AI/ML capabilities across the organization. - Growth: Help shape and build our data-driven culture from the ground up. - Learning: Work with the latest in AI, code, and data technologies. - Culture: Flat hierarchy, collaborative, and outcome-driven team.

  • Senior data engineer

    7 days ago

    Kollam, India Pacific Data Integrators Full time

    Role: Senior Data Engineer Location: Remote Job Type: Full-time Shift time: Open to work in EST shift (5 PM to 2 AM IST) Key Responsibilities Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC). Develop, document, unit test, and maintain high-quality ETL...

  • Senior data engineer

    7 days ago

    Kollam, India Veraxion Full time

    We’re Hiring: Senior Data Engineer (Azure) We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across the organization. If you love solving complex data problems, architecting scalable pipelines, and working with cutting-edge Azure technologies — this role is for...

  • Senior Data Engineer

    2 weeks ago

    Kollam, India Tata Consultancy Services Full time

    Role**: Senior Data EngineerRequired Technical Skill Set: Senior Data EngineerDesired Experience Range: 7 - 12 yrsNotice Period: Immediate to 90Days onlyLocation of Requirement: BangaloreWe are currently planning to do a Virtual InterviewJob Description:Primary Skills (Java, Python, etc.)Python, Scala/Java, Spark, SQL, Snowflake, BDD, Databricks, AWS Key...

  • Data Engineer

    2 weeks ago

    Kollam, India Aceolution Full time

    Job Title: Data Engineer – Python Expert(Freelance Role)Location: Remote / HybridEmployment Type: Contract/ FreelanceRole Summary We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) development. As a senior Individual Contributor (IC), you will be the team's expert on...

  • Senior backend engineer

    2 weeks ago

    Kollam, India Pramaan Labs Full time

    Senior Backend Engineer Location:  India - Remote Type:  Full-time Compensation: ₹20-50 LPA basis experience We are hiring a Senior Backend Engineer  on behalf of a fast-growing Saa S startup that is building intelligent inventory and forecasting systems for modern e-commerce businesses. As one of the first backend hires, you will work closely with the...

  • Data Engineer

    3 days ago

    Kollam, India LanceSoft, Inc. Full time

    Pay Rate: $11.00/hr to $12.00/hrLocation: 100% Remote working from IndiaDuration of contract: This is 4 to 4.5 months contract jobWorking Hours: US working hours (Night Shift form india)This team is looking to hire a motivated Sr. Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-art marketing data...

  • Senior Python Data Engineer

    4 days ago

    Kollam, India Whatjobs IN C2 Full time

    About the Project: Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season. The core goal is to modernize and significantly accelerate the generation of Excel-based reports, reducing report generation time from minutes to seconds. This involves ingesting data from multiple upstream systems, transforming it...

  • Software Engineer, Data and Information Systems

    7 days ago

    Kollam, Kerala, India Amrita University Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    The Amrita AHEAD, Amrita Vishwa Vidyapeetham AHEAD – Online Campus is inviting applications from qualified candidates for the post of a Software Engineer, Data and Information Systems.For details contact : Job Title Software Engineer, Data and Information SystemsLocation Kollam, KeralaRequired Number 2Qualification CS DomainJob DescriptionThe role involves...

  • Senior Data Architect

    1 week ago

    kollam, India beBeeDataEngineer Full time

    Data EngineerWe are seeking a skilled Data Engineer to support the backend infrastructure for a major reporting migration from Tableau to Google Looker.Design and implement scalable data models (conceptual, logical, and physical) to facilitate analytics.Build and maintain ETL/ELT pipelines to extract, transform, and load data into the data warehouse.Develop...

  • Data Engineer

    3 weeks ago

    Kollam, India Digitalzone Full time

    About the RoleAs a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.ResponsibilitiesDevelop and maintain scalable ETL/ELT pipelines using Python, Airflow, and dbt Build and optimize real-time streaming pipelines using Kafka, RabbitMQ, Spark and event-driven microservices...