Big Data Engineer
4 days ago
Role: Big Data Engineer
Location: Hyderabad, India (Hybrid).
Experience: 5+ Years
Duration: 1 year+
Notice Period: Immediate -15 days.
Key Responsibilities:
- Design, develop, and maintain scalable data processing pipelines using Spark/PySpark and Hadoop on AWS.
- Implement and optimize data workflows on AWS EMR, EC2, and ECS.
- Develop and integrate RESTful APIs and AWS Gateway services using Scala/Java.
- Collaborate with cross-functional teams to understand data requirements and deliver robust solutions.
- Ensure data quality, performance, and reliability across all systems.
- Participate in code reviews, testing, and deployment processes.
Required Skills & Qualifications:
- 3 - 5 years of experience in Big Data Engineering.
- Strong hands-on experience with Spark/PySpark, Hadoop, and AWS services.
- Proficiency in Scala or Java for backend and API development.
- Experience with AWS EMR, EC2, ECS, and API Gateway.
- Solid understanding of RESTful API design and integration.
- Familiarity with CI/CD pipelines and version control (e.g., Git).
- Excellent problem-solving and communication skills.
Preferred Qualifications:
- Experience in data security and compliance within cloud environments.
- Exposure to data lake architectures and real-time data processing.
- Knowledge of containerization tools like Docker and orchestration with Kubernetes.
Please share your updated CV to or contact
-
Big Data Engineer
1 week ago
Hyderabad, Telangana, India Sky Systems, Inc. (SkySys) Full timeRole:Big Data EngineerPosition Type:Full-Time Contract (40hrs/week)Contract Duration:Long TermWork Schedule: 8 hours/day (Mon-Fri)Location: Hybrid - Hyderabad, India (3x days onsite/week)We are looking for a skilledBig Data Engineer (5+ years' experience)to join Experian's dynamic data engineering team. You will design and optimize scalable data pipelines,...
-
Big Data Engineer
2 weeks ago
Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe are looking for a skilled Big Data Engineer with 6 to 22 years of experience. The ideal candidate will have expertise in Pyspark, Azure Data Bricks, and workflows. This position is available as a contract role across Pan India.Roles and ResponsibilityDesign and develop scalable big data systems using Pyspark and Azure Data Bricks.Implement and manage...
-
Big Data Engineer
1 week ago
Hyderabad, Telangana, India Harp Technologies Services Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob Title: Bigdata + PysparkLocation: HyderabadExperience Level: 5-8 YearsNotice Period: Immediate to 30 DaysInterview Mode: L1 Virtual / L2 F2F (Mandatory)Work Mode: HybridJob SummaryWe are seeking a Specialist with 5 to 8 years of experience in the Big Data Hadoop Ecosystem to design and implement scalable data solutions.Detailed Job DescriptionWork...
-
Big Data Operations Engineer
2 days ago
Hyderabad, Telangana, India S M Software Solutions Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Description – Big Data Operations EngineerLocation :Onsite, Hyderabad SoftilityExperience: 5+ yearsRole OverviewWe are looking for a skilledBig Data Operations Engineerwith hands-on experience in supporting and maintaining large-scale data platforms. The role involves ensuring platform availability, managing incidents, monitoring performance through...
-
Big Data Engineer
2 weeks ago
Hyderabad, Telangana, India Hucon Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year5+ years of experience working in a software product development organization building modern and scalable big data applicationsExpertise with functional programming, preferably ScalaFluency in Hadoop technologies and big data processing technologies, e.g. Spark, YARN, HDFS, Oozie, HiveExperience implementing RESTful web services in Java, Scala, Python, or...
-
Big Data Engineer
7 days ago
Hyderabad, Telangana, India Hucon Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearKEY RESPONSIBILITIES:5+ years of experience working in a software product development organization building modern and scalable big data applications• Expertise with functional programming, preferably Scala• Fluency in Hadoop technologies and big data processing technologies, e.g. Spark, YARN, HDFS, Oozie, Hive• Experience implementing RESTful web...
-
Big Data Engineer
7 days ago
Hyderabad, Telangana, India Techno Facts Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per yearExperience in developing and delivering scalable big data pipelines using Apache Spark and Databricks on AWS.Position Requirements :Must Have : Build and maintain scalable data pipelines using Databricks and Apache Spark. Develop and optimize ETL/ELT processes for structured and unstructured data. Knowledge of Lakehouse architecture for efficient data...
-
Big data engineer/Developer
2 weeks ago
Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 15,00,000 - ₹ 25,00,000 per yearBig data engineer/DeveloperSpark-ScalaHQL, HiveControl-mJinkinsGitTechnical analysis and up to some extent business analysis (knowledge about banking products, credit cards and its transactions)Notice Period:Immediate.Employment Type: Contract
-
Staff Engineer, Big Data Engineer
1 week ago
Hyderabad, Telangana, India Nagarro Full time ₹ 20,00,000 - ₹ 25,00,000 per yearWe're Nagarro.We are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world experts across 38 countries, to be exact). Our work culture is dynamic and...
-
ETL or Big data tester
2 weeks ago
Hyderabad, Telangana, India Altura Innovative Technologes Full time ₹ 5,00,000 - ₹ 18,00,000 per yearWe're Hiring – ETL or Big data Testing (Hyderabad, India)Altura Innovative Technologies Pvt Ltd is looking for a QA Testing to join our client teamExperience: 6 to 12 yearsAnalyze business requirements and technical specifications to design test scenarios for ETL and big data processes.Develop, maintain, and execute test cases, test scripts, and SQL...