Data Engineer
2 hours ago
Data Engineer
India, Remote
Full Time /Contract
# of Positions - 3
Job Summary
The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise in ETL/ELT processes, and deep hands-on experience with AWS cloud services such as S3, Glue, Lambda, Redshift, Kinesis, and DynamoDB. The ideal candidate will excel in building serverless data architectures, designing efficient data models, and ensuring robust pipeline performance through monitoring and optimization. The position is remote within India and open for both full-time and contract engagements.
Key Skills
Data Engineering & Pipelines
- ETL/ELT pipeline development using Python
- Data extraction, transformation, and loading into data lakes/warehouses
- Workflow orchestration and automation
- Real-time and batch data processing
AWS Cloud Expertise
- S3, Glue, Lambda, Redshift, Aurora
- Kinesis (real-time streaming)
- DynamoDB (NoSQL databases)
- AWS serverless architecture design
- Integration of AWS managed services for data workflows
Serverless & Automation
- Building event-driven pipelines using AWS Lambda
- Serverless compute optimization
- Automated triggering and orchestration of data processes
Data Modeling
- Designing schemas for relational databases (OLTP/OLAP)
- NoSQL data modeling and storage optimization
- Understanding of normalization, partitioning, indexing
Monitoring & Optimization
- AWS monitoring tools (CloudWatch, CloudTrail)
- Pipeline performance tuning
- Cost optimization across cloud resources
Collaboration & Communication
- Cross-functional collaboration with analysts, data scientists, and engineering teams
- Strong problem-solving, documentation, and communication skills
Minimum Qualifications
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field (preferred).
- Strong hands-on experience with Python for data engineering tasks.
- Deep understanding of AWS cloud services used for data storage, streaming, ETL, and serverless compute.
- Experience designing and implementing ETL/ELT pipelines.
- Solid understanding of relational and NoSQL data modeling concepts.
Professional Experience Requirements
- Proven experience building scalable data pipelines using Python.
- Experience extracting and transforming data from diverse sources into cloud-based environments.
- Hands-on experience with AWS services such as S3, Glue ETL, Lambda, Redshift/Aurora, Kinesis, and DynamoDB.
- Demonstrated ability to design and implement serverless architectures.
- Experience creating event-driven workflows using Lambda and other AWS triggers.
- Strong experience in monitoring, debugging, and optimizing cloud-based data workflows.
- Experience collaborating across data science, analytics, and engineering teams to deliver complete data solutions.
-
Senior Data Engineer
2 hours ago
Gurugram, Haryana, India, IN Pacific Data Integrators Full timeRole: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5PM to 2AM IST) Key ResponsibilitiesLead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).Develop, document, unit test, and maintain high-quality ETL applications that...
-
Data Engineer
2 hours ago
india, IN Grantify Full timeCompany Description Grantify is an innovative education platform that connects students and universities through a transparent admissions and tuition-matching ecosystem. By aligning student budgets and academic aspirations with tailored university offers, Grantify facilitates a data-driven pathway to higher education. Our platform aims to simplify the...
-
Data Engineer
2 hours ago
india, IN TerraGiG Full timeResponsibilities Lead the design, development, and implementation of data solutions using AWS and Snowflake. Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. Develop and maintain data pipelines, ensuring data quality, integrity, and security. Optimize data storage and retrieval processes...
-
Data Engineer
2 hours ago
india, IN IntraEdge Full timeWe are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reliable data pipelines that drive business insights and operational efficiency. This role requires a deep understanding of data modeling, ETL frameworks, and...
-
Data Engineer
2 hours ago
india, IN Vriba Solutions Full timeRole: Data EngineeringRemoteLooking for 5-10 years of ExpSkill Set:AWS, Snowflake, Kafka, Airflow, GitHub, PySpark, PythonKey Responsibilities:Design, develop, and maintain scalable ETL/ELT pipelinesIngest data from various sources (APIs, databases, files, etc.)Implement both real-time and batch processing solutions based on use case requirementsEnsure data...
-
Data Engineer
2 hours ago
india, IN Randstad Enterprise Full timeRole : Data EngineerLocation : RemoteShift Timing : 2:00 Pm - 11:00 PmExperience : 2- 4 years relevant Experience only ( this is a Junior position with us )Must have skillset :GCP - 2 years minimum working ExperiencePython and Pyspark - 2 yearsSQL - 2 yearsExcellent communicationWorked with global stakeholdersWho we are:Randstad Sourceright’s global talent...
-
Customer Engineer
2 hours ago
, India, IN Konecta Full timeIn this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams both internally and externally. You are a customer-facing data engineer who genuinely loves solving problems and can handle client expectations while working on...
-
Senior Data Engineer
2 hours ago
, India, IN Donyati Full timeSenior Data Engineer Job Title: Senior Data EngineerLocation: Remote/ Willing to TravelJob Type: Full-timeExperience Level: 8+ yearsAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS. You will play a key role in transitioning from legacy systems to a scalable, cloud-native...
-
Senior Data Engineer
2 hours ago
india, IN Intellify Solutions Full timeTitle: Senior Data EngineerLocation: Remote, IndiaTotal years of experience: 10+ years Requirements:● Required: Bachelor’s degree or relevant experience● Required: Prior experience as a software engineer or data engineer in afast-paced, technical, problem-solving environment● Required: Cloud Data Warehouse experience - Snowflake● Required: Expert...
-
Palantir Data Engineer
2 hours ago
india, IN SageBeans RPO Full timeJob Title: Lead Data EngineerLocation: Remote work in IndiaJob Type: Contract 6 MonthsExperience and skills required for the Palantir Forward Deployed Engineer, Palantir FDEStrong programming skills in Python, SQL and optionally Java/Scala.Hands on experience with Palantir Foundry tools including:Code repositories, Pipeline Builder, Code workbook.Ontology...