Senior Data Engineer

1 week ago

India Millipixels Interactive Full time

Who we are  

At Millipixels, we design impactful experiences for our clients worldwide in various domains and emerging technologies. With our primary design and development center and offices in the Chandigarh Tricity area in India, combined with FlexCampus spaces in New Delhi, Mumbai, Bangalore, and upcoming offices in the UK, Singapore, and the United States, we are on course to be a globally-relevant, distributed, full-service software solutions organization. 

Working remotely from locations worldwide, our employees work with our cloud-native infrastructure and processes, untethered to a physical location. As a Remote-First organization, we ensure that our people don't have to compromise between their home and work lives by enabling our people to stay connected to their families while building fulfilling careers. 


Job Overview

We are seeking a highly skilled Data Engineer with expertise in cloud data architectures, real-time and batch data services, and data operations (DataOps). The ideal candidate will have advanced proficiency in AWS , Python, SQL, and a deep understanding of relational and non-relational data modeling. You will be responsible for designing and developing scalable cloud data solutions, optimizing data workflows, and ensuring smooth integration across various cloud-based services. 


Key Responsibilities: 

  • Architect, design, and implement cloud-based data solutions primarily on AWS to handle large-scale, high-volume data pipelines. 
  • Develop batch and real-time data services to support analytics, machine learning, and business intelligence needs. 
  • Design and implement data models for both relational (e.g., Amazon Redshift, PostgreSQL) and non-relational (e.g., DynamoDB, Elasticsearch, OpenSearch) data stores. 
  • Develop, optimize, and maintain ETL pipelines and data workflows using industry best practices. 
  • Implement DataOps principles to ensure the automation, monitoring, and reliability of data systems. 
  • Work closely with cross-functional teams to ensure data pipelines align with business requirements and technical constraints. 
  • Continuously monitor and improve the performance and scalability of cloud-based data solutions. 
  • Collaborate with DevOps teams to design and implement Infrastructure as Code (IaC) using CloudFormation or AWS CDK . 
  • Implement and manage CI/CD pipelines for automated deployments and continuous integration using Bitbucket Pipelines or Drone CI . 
  • Optimize cloud infrastructure and services for cost efficiency using AWS Cost Explorer and other pricing tools. 
  • Troubleshoot data pipeline issues, debug complex systems, and ensure the timely resolution of incidents. 
  • Document solutions and provide high-quality technical documentation to support long-term system maintenance and team knowledge transfer. 


Required Technical Skills:  

Cloud Architecture: Experience designing and deploying cloud-based data architectures on AWS . 

Data Modeling: Proficiency in relational and non-relational data modeling techniques. 

Programming: Advanced knowledge of Python and SQL for developing data solutions. 

Cloud Services: Strong experience with AWS services including but not limited to EC2 , VPC , ECS , ECR , Athena , Lambda , AppSync , Redshift , RDS , Kinesis , S3 , IAM , CloudWatch , SNS , SQS , Elasticsearch , OpenSearch , CloudFront . 

IaC (Infrastructure as Code): Hands-on experience with CloudFormation or AWS CDK for managing cloud resources. 

CI/CD: Experience with Bitbucket Pipelines , Drone CI , or similar CI/CD tools. 

Containerization: Expertise in Docker for containerizing applications. 

Version Control: Proficiency in using Bitbucket or other version control systems. 

Scripting: Familiarity with Bash scripting for automation and process improvement. 


Essential Soft Skills:  

  • Communication: Excellent communication skills, with the ability to explain complex technical concepts to both technical and non-technical stakeholders. 
  • Collaboration: Strong team player, willing to collaborate closely with peers to design, develop, test, and troubleshoot solutions. 
  • Proactive Problem-Solving: Ability to identify potential risks and issues early and escalate them effectively. 
  • Documentation: High standards for maintaining clear and concise technical documentation. 
  • Attention to Detail: Ensuring high-quality code and system reliability through rigorous testing and documentation standards. 


Preferred Qualifications:  

  • Experience working with real-time data streaming technologies (e.g., Kinesis , Kafka ). 
  • Knowledge of machine learning frameworks or big data technologies. 
  • Familiarity with AWS Lambda and serverless architectures. 
  • Experience with data governance and security protocols in the cloud. 


Benefits of working at Millipixels

  •  Work in our FlexCampus model 
  • Work with global clients, enhance your profile 
  • Medical Health Insurance - Company Paid Health insurance for ₹500,000 
  • Company-paid participation in Industry-specific Seminars and Events 
  • Regular Financial, Tax-Saving, and Healthcare Advice Sessions from Experts 
  • Technical Certification and Periodical Reimbursements 
  • Generous paid vacation (split over the course of the year) 


  • Data Warehouse Engineer

    4 weeks ago

    India Data Warehouse Engineer Full time

    Experience : 2- 5 Years Primary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills. Good to have skills: Power BI, Databricks, Python.

  • Data Warehouse Expert for Analytics Projects

    4 weeks ago

    India Data Warehouse Engineer Full time

    About the RoleWe are seeking an experienced Data Warehouse Engineer to join our team. In this role, you will design, develop, and maintain data warehouses that support business intelligence and analytics initiatives.

  • Data engineer

    2 weeks ago

    India Pacific Data Integrators Full time

    Job Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on...

  • Data Engineer

    2 weeks ago

    India Pacific Data Integrators Full time

    Job Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on...

  • Data Engineer

    2 weeks ago

    India Pacific Data Integrators Full time

    Job Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...

  • Data Engineer

    2 weeks ago

    India Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in...

  • Senior data engineer

    2 weeks ago

    India Trek Health Full time

    Company Description Trek Health is revolutionizing healthcare with its Payer Price Transparency Analytics Platform. Our solutions offer payer-provider price transparency insights and analytics. We take pride in ingesting and processsing multi-terabytes of data every month and provide actionable insights to our customers. The company is backed by $3 M seed...

  • Pyspark data engineer

    2 weeks ago

    India ITI Data Full time

    Location : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are...

  • Cloud Data Engineering Lead

    4 weeks ago

    India ITI Data Full time

    ITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...

  • ITI Data | PySpark Data Engineer

    3 weeks ago

    india ITI Data Full time

    Location : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are looking for a PySpark...

  • ITI Data | PySpark Data Engineer

    3 weeks ago

    india ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...

  • Senior Data Infrastructure Architect

    3 weeks ago

    India OSD Data Services Full time

    About the RoleWe are seeking a highly skilled Senior Data Infrastructure Architect to join our team at OSD Data Services. This is an exciting opportunity to work with cutting-edge technologies and be part of a fast-growing company that's transforming how businesses leverage their data.

  • Senior Data Engineer

    2 weeks ago

    India Trek Health Full time

    Company Description Trek Health is revolutionizing healthcare with its Payer Price Transparency Analytics Platform. Our solutions offer payer-provider price transparency insights and analytics. We take pride in ingesting and processsing multi-terabytes of data every month and provide actionable insights to our customers. The company is backed by $3M seed...

  • Senior Data Engineer

    2 weeks ago

    India Trek Health Full time

    Company DescriptionTrek Health is revolutionizing healthcare with its Payer Price Transparency Analytics Platform. Our solutions offer payer-provider price transparency insights and analytics. We take pride in ingesting and processsing multi-terabytes of data every month and provide actionable insights to our customers. The company is backed by $3M seed...

  • Senior Data Engineer

    2 weeks ago

    India Trek Health Full time

    Company Description Trek Health is revolutionizing healthcare with its Payer Price Transparency Analytics Platform. Our solutions offer payer-provider price transparency insights and analytics. We take pride in ingesting and processsing multi-terabytes of data every month and provide actionable insights to our customers. The company is backed by $3M seed...

  • PySpark Data Engineer

    3 weeks ago

    India ITI Data Full time

    Location : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are looking for a PySpark...

  • PySpark Data Engineer

    3 weeks ago

    India ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...

  • Senior Cloud Data Engineer

    1 day ago

    India Recro Full time

    Job Title: Senior Cloud Data EngineerWe are seeking a highly skilled AWS Data Engineer to join our team as a Senior Cloud Data Engineer. The successful candidate will have 5+ years of experience in data engineering, with a strong background in AWS services and advanced proficiency in Python, Py Spark, and data pipeline architecture.This is an exciting...

  • Data Platform Engineer

    3 weeks ago

    India OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Data Platform Engineer

    3 weeks ago

    India OSD Data Services Full time

    Data Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...