Big data Engineer
22 hours ago
Role Overview
We are looking for
two Junior-level Big Data Engineers
with strong hands-on experience in
AWS, Python, Apache Airflow, and Big Data technologies
. The ideal candidates will design, build, and maintain
scalable data pipelines and workflows
in a cloud-based environment, ensuring data reliability, performance, and security.
Key Responsibilities
- Design, develop, and maintain ETL data pipelines using Apache Airflow.
Build scalable data solutions on AWS, leveraging services such as:
Amazon S3
- EC2
- AWS Lambda
- EMR
- AWS Glue
Amazon Redshift
Write clean, efficient, and maintainable Python code for data processing and automation.
- Work with Big Data frameworks such as Spark and Hadoop for large-scale data processing.
- Optimize workflows for performance, scalability, and cost efficiency.
- Collaborate with cross-functional teams to gather data requirements and deliver solutions.
- Ensure data quality, reliability, and security across pipelines and processes.
- Troubleshoot pipeline failures and resolve performance bottlenecks.
Required Qualifications
- 3–5 years of hands-on experience in Data Engineering roles.
- Strong experience with AWS cloud services for data engineering workloads.
- Proficiency in Python, including libraries such as Pandas and PySpark.
- Hands-on experience with Apache Airflow, including DAG creation and monitoring.
- Familiarity with Big Data technologies (Spark, Hadoop, or similar).
- Solid understanding of ETL processes and data modeling concepts.
- Strong analytical, problem-solving, and debugging skills.
- Excellent communication and collaboration abilities.
Preferred Qualifications
- Experience with CI/CD pipelines and DevOps practices.
- Knowledge of SQL and relational databases.
- Familiarity with containerization technologies such as Docker and Kubernetes.
- Exposure to monitoring and logging tools in cloud environments
Skills: python,airflow,aws,big data
-
Big Data Engineer
2 days ago
Hyderabad, Telangana, India Ascendion Engineering Full timeBig Data Engineer:(Note - One in-person interview is needed after first round selection, Location - Hyderabad)BS degree in computer science, computer engineering or equivalent3-5 years of experience delivering enterprise software solutionsFamiliar with Spark, Scala, Python, AWS Cloud technologies2+ years of experience across multiple Hadoop / Spark...
-
Big Data QA/Test Engineer
19 hours ago
Hyderabad, Telangana, India deltaclass technology solutions Full timeRole : Bigdata QA Test Engineer Exp : 6+Yrs Notice :Immediate to 15 Days Location:Hyderabad (Hybrid) Big Data QA/Test engineer – 3 Openings Hyderabad or Chennai (Hybrid) Big Data QA/Test Engineer AWS + Data-bricks + Big Data + Python + DevOps Big Data QA/Test Engineer AWS + Data-bricks + Big Data + Python + DevOps Big Data QA/Test Engineer AWS +...
-
Big Data Engineer
3 days ago
Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full timeWe are looking for a skilled Big Data Developer with 6-8 years of experience to join our team in Hyderabad/Pune. The ideal candidate will have strong knowledge of Unix/BigData Scripting and a solid understanding of BigData (CDP/Hive) Environment.Roles and ResponsibilityDesign, develop, and implement big data solutions using Hadoop/CDP, Hive.Collaborate with...
-
Big Data Engineer
2 weeks ago
Hyderabad, Telangana, India Hucon Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearKEY RESPONSIBILITIES:5+ years of experience working in a software product development organization building modern and scalable big data applications• Expertise with functional programming, preferably Scala• Fluency in Hadoop technologies and big data processing technologies, e.g. Spark, YARN, HDFS, Oozie, Hive• Experience implementing RESTful web...
-
Big Data and Cloud Data Engineer
4 days ago
Hyderabad, Telangana, India State Street Full timeBig Data and Cloud Data Engineer - OfficerWho we are looking forRole OverviewA Data Engineer in the cloud is primarily responsible for designing, building, and managing scalable data infrastructure and pipelines. They work to ensure that data is accessible, reliable, and processed efficiently for various business needs. This role involves a mix of software...
-
Big Data Engineer(AWS, Python,Airflow)
15 hours ago
Hyderabad, Telangana, India Zorba AI Full timeJob Description – AWS / Python / Airflow / Big Data EngineerRole:AWS / Python / Airflow / Big Data EngineerExperience:3–5 YearsJob OverviewWe are seekingtwo skilled AWS/Python/Airflow/Big Data Engineerswith3–5 years of hands-on experienceto join our data engineering team. The ideal candidates will be responsible fordesigning, developing, and...
-
Big Data Developer
4 days ago
Hyderabad, Telangana, India MobMaxime Full timeKey Responsibilities:Design, develop, and maintain scalable big data systems and pipelines.Implement data processing frameworks and optimize large datasets using tools such as Hadoop, Spark, and Hive.Develop and maintain ETL processes to ensure data availability, accuracy, and quality for downstream applications.Collaborate with data architects, analysts,...
-
Azure Data Engineer
2 weeks ago
Hyderabad, Telangana, India Enable Data Full time ₹ 6,00,000 - ₹ 18,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
LMTS / SMTS Data Engineer (ETL & Big-Data)
1 week ago
Hyderabad, Telangana, India griddable Full timeDescriptionThe Salesforce Engineering team is looking for a Senior Data Engineer (SMTS) with experience in distributed systems to join us.You will be working cross-functionally with engineers, architects, and product managers to build the breakthrough features that our internal customers will love, adopt and use while ensuring stable and scalable...
-
Staff Software Engineer, Big Data
2 days ago
Hyderabad, Telangana, India Google Full timeMinimum qualifications:Bachelor's degree or equivalent practical experience.8 years of experience with one or more general purpose programming languages including but not limited to: Java, C/C++ or Python.5 years of experience testing, and launching software products.Preferred qualifications:8 years of experience with data structures/algorithms.Experience...