Data Engineer

3 weeks ago

Kollam, India Digitalzone Full time

About the RoleAs a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.ResponsibilitiesDevelop and maintain scalable ETL/ELT pipelines using Python, Airflow, and dbt Build and optimize real-time streaming pipelines using Kafka, RabbitMQ, Spark and event-driven microservices Leverage AI coding agents (Claude Code, Cursor AI, GitHub Copilot) to accelerate data pipeline development, data transformation, and optimization Design and manage data storage solutions with PostgreSQL, ClickHouse and Elasticsearch Define and implement data modeling best practices for efficient and scalable data storage. Ensure high availability, performance, and security of data infrastructure on AWS cloud Design and implement BI-ready datasets in ClickHouse optimized for OLAP workloads and reporting use cases. Develop and manage denormalized schemas and data models to support analytics and amCharts-based reporting. Optimize query performance, partitioning, and indexing strategies in ClickHouse to handle large-scale analytical workloads. Implement best practices for data quality, validation, and observability Work on data ingestion using Airbyte or other connector frameworks Implement data transformation pipelines supporting analytical and ML workloads Collaborate with cloud and DevOps teams for containerized deployments (Docker, Kubernetes, AWS) Support integration of ML workflows and model APIs into production pipelinesQualifications6+ years of hands-on experience in data engineering and distributed systems.Required SkillsExperience with AI-assisted coding tools (Claude Code, GitHub Copilot, Cursor AI) Strong expertise in ClickHouse for analytics, including data modeling, partitioning, indexing, and query optimization. Proven ability to design and manage denormalized OLAP datasets to support BI and reporting workloads. Solid understanding of ETL/ELT pipelines and experience with tools such as Airbyte, DBT, Airflow or Python-based transformations. Proficiency in SQL (advanced queries, performance tuning, window functions, aggregations). Hands-on experience working with reporting/visualization frameworks (e.g., amCharts or similar libraries). Strong foundation in data quality, governance, and validation to ensure reliable analytics. Strong knowledge of real-time data streaming (Kafka, Spark) Experience with relational and analytical databases (Postgres, ClickHouse, Elasticsearch) Exposure to ML model integration, MLOps is a strong plus Strong problem-solving, debugging, and cross-team collaboration skillsPreferred Skills Experience with relational and analytical databases (Postgres, ClickHouse, Elasticsearch) Exposure to ML model integration, MLOps is a strong plus

  • Senior data engineer

    7 days ago

    Kollam, India Pacific Data Integrators Full time

    Role: Senior Data Engineer Location: Remote Job Type: Full-time Shift time: Open to work in EST shift (5 PM to 2 AM IST) Key Responsibilities Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC). Develop, document, unit test, and maintain high-quality ETL...

  • Data Engineer

    2 weeks ago

    Kollam, India Aceolution Full time

    Job Title: Data Engineer – Python Expert(Freelance Role)Location: Remote / HybridEmployment Type: Contract/ FreelanceRole Summary We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) development. As a senior Individual Contributor (IC), you will be the team's expert on...

  • Data Engineer

    3 days ago

    Kollam, India LanceSoft, Inc. Full time

    Pay Rate: $11.00/hr to $12.00/hrLocation: 100% Remote working from IndiaDuration of contract: This is 4 to 4.5 months contract jobWorking Hours: US working hours (Night Shift form india)This team is looking to hire a motivated Sr. Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-art marketing data...

  • Senior data engineer

    7 days ago

    Kollam, India Veraxion Full time

    We’re Hiring: Senior Data Engineer (Azure) We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across the organization. If you love solving complex data problems, architecting scalable pipelines, and working with cutting-edge Azure technologies — this role is for...

  • Customer engineer

    2 days ago

    Kollam, India Konecta Full time

    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams both internally and externally. You are a customer-facing data engineer who genuinely loves solving problems and can handle client expectations while working on...

  • Senior Data Engineer

    2 weeks ago

    Kollam, India Tata Consultancy Services Full time

    Role**: Senior Data EngineerRequired Technical Skill Set: Senior Data EngineerDesired Experience Range: 7 - 12 yrsNotice Period: Immediate to 90Days onlyLocation of Requirement: BangaloreWe are currently planning to do a Virtual InterviewJob Description:Primary Skills (Java, Python, etc.)Python, Scala/Java, Spark, SQL, Snowflake, BDD, Databricks, AWS Key...

  • Data Engineer(Intern)

    14 hours ago

    Kollam, India Whatjobs IN C2 Full time

    Company Description Tech Phoenix is a dynamic platform dedicated to all things technology, offering the latest news, trends, and insights from the tech industry. Whether you are a tech enthusiast or a professional, our website features engaging articles, exclusive interviews, and resourceful guides to keep you informed and inspired. We foster an interactive...

  • Sr.azure data engineer

    7 days ago

    Kollam, India Persistent Systems Full time

    About Position: We are looking for Sr Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team. Role: Sr. Azure Data Engineer Location: Pune/Bangalore Experience: 5 to 8 years Job Type: Full Time Employment What You'll Do: Design and implement complex, scalable data pipelines for ingestion, processing, and...

  • Data engineer

    2 weeks ago

    Kollam, India Quantiphi Full time

    Role: Associate Architect - Data Experience Level: 6.5 to 12 Years Work location: Mumbai, Bangalore, Trivandrum Role & Responsibilities: 6+ years of experience in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration and Business Intelligence/Artificial Intelligence solutions on GCP Cloud. Ability to understand business...

  • Data Engineer

    3 weeks ago

    Kollam, India Add Min Web World Full time

    Job Title: Data Engineer (Qlik Experience)Location: Mohali (On-site)Experience: Minimum 2 YearWorking Days: 5 Days a WeekJob Description:We are looking for a dedicated Data Engineer who has hands-on experience working with Qlik and other data tools. The ideal candidate should have a strong understanding of data processing, integration, and reporting, along...