Big Data Python Engineer
6 months ago
Exp 5+
Location Pune/Hyderabad
MUST Have Skills
Design and implement data processing pipelines using Python + SCALA programming and big data technologies such as Hadoop, MapReduce, Hive, and Spark.
Airflow
Jenkins
Understand business requirements to code up data assets in pyspark. Design, develop, test, and maintain data assets.
Troubleshoot, debug, and optimise data pipelines for maximum performance and scalability.
Collaborate with data and business analysts to implement data solutions that meet business requirements.
Nice to have skills
API experience Java
Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary Skills PySpark Years of Experience 5 Qualification
Role GDT WS Big Data Python Engineer
Exp 5+
Location Pune/Hyderabad
MUST Have Skills
Design and implement data processing pipelines using Python + SCALA programming and big data technologies such as Hadoop, MapReduce, Hive, and Spark.
Airflow
Jenkins
Understand business requirements to code up data assets in pyspark. Design, develop, test, and maintain data assets.
Troubleshoot, debug, and optimise data pipelines for maximum performance and scalability.
Collaborate with data and business analysts to implement data solutions that meet business requirements.
Nice to have skills
API experience Java
-
Innovative Big Data Solutions Engineer
4 weeks ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Solutions Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data products components based on requirements with possible technical solutions.You will work closely with Data Scientists, Data Engineers,...
-
Data Engineer(Python+Big Data)
3 weeks ago
Hyderabad, India iitjobs, Inc. Full timeHello Folks,Are you a tech enthusiast or a sales ace looking for a new opportunity? Look no further! We're hiring for various positions.We are hiring Data Engineer/Data Scientist who enjoys working to join an innovative and growing organisation with experience on Python, SQL, Building data pipelines in big data environments, Tableau, Data Visualization and...
-
Big data engineer
6 months ago
Hyderabad, India Virtusa Full timeBig data engineer - CREQ189284 Description Position: Big data engineer Primary: big data concepts, aws, pyspark Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge...
-
Big data engineer
2 months ago
Hyderabad, India Anblicks Full timeExperience- 4+ yearsExperience in hadoop/big data technologies.Experience in spark.Experience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies (e.g. Docker,...
-
Big Data Engineer
2 months ago
hyderabad, India Anblicks Full timeExperience- 4+ yearsExperience in hadoop/big data technologies.Experience in spark.Experience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies (e.g. Docker,...
-
Big Data Engineer
2 months ago
Hyderabad, India Anblicks Full timeExperience- 4+ yearsExperience in hadoop/big data technologies.Experience in spark.Experience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies (e.g. Docker,...
-
Big Data Engineer
2 months ago
Hyderabad, India Anblicks Full timeExperience- 4+ yearsExperience in hadoop/big data technologies.Experience in spark.Experience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies (e.g. Docker,...
-
Big Data Engineer
2 months ago
Hyderabad, India Anblicks Full timeExperience- 4+ yearsExperience in hadoop/big data technologies.Experience in spark.Experience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies (e.g. Docker,...
-
Big Data Engineer
2 months ago
Hyderabad, India Anblicks Full timeExperience- 4+ years Experience in hadoop/big data technologies. Experience in spark. Experience working on Google or AWS cloud developing data solutions. Certifications preferred. Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required; Experience with containerization and related technologies (e.g. Docker,...
-
Senior Cloud Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeTata Consultancy Services is a leading IT services company seeking an experienced Senior Cloud Big Data Engineer to join our team in Hyderabad. The successful candidate will have 5-10 years of experience in developing scalable big data applications using Python and AWS services.Key ResponsibilitiesDevelop and maintain high-performance big data solutions...
-
Big Data Engineer Position
4 weeks ago
Hyderabad, Telangana, India Anblicks Full timeWe are looking for a skilled Big Data Engineer to join our team at Anblicks. This is a full-time opportunity with a competitive salary and excellent benefits.Key Responsibilities:Design, develop, and deploy large-scale data processing systems using Hadoop and Spark technologies.Collaborate with cross-functional teams to identify business requirements and...
-
Senior Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India People Tech Group Inc Full timeWe are seeking a highly skilled Senior Big Data Engineer to join our team at People Tech Group Inc. This is a fantastic opportunity for someone looking to leverage their expertise in big data processing and analytics to drive business growth.Job DescriptionIn this role, you will be responsible for designing, developing, and implementing large-scale data...
-
AWS Big Data Engineer
6 months ago
Hyderabad, India Tiger Analytics Full timeJob Description We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch...
-
Senior Big Data Analyst with Python Expertise
2 weeks ago
Hyderabad, Telangana, India iitjobs, Inc. Full timeCompany Overviewiitjobs, Inc. is a leading provider of innovative solutions in the tech industry.SalaryThe estimated salary for this position ranges from ₹25 lakhs to ₹50 lakhs per annum, depending on experience and qualifications.Job DescriptionWe are seeking an experienced Data Engineer/Data Scientist who enjoys working on cutting-edge projects to join...
-
Big Data Engineering Lead
1 month ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeAbout Tata Consultancy ServicesTata Consultancy Services is a leading IT services company that empowers global businesses through its cutting-edge technology and innovative solutions.Compensation PackageThe estimated salary for this role is around $120,000 - $180,000 per annum, depending on the location and individual qualifications.About the RoleJob...
-
Data Engineer/Scientist with Big Data Expertise
3 weeks ago
Hyderabad, Telangana, India Cloud Counselage Pvt Ltd Full timeAre you a skilled Python professional looking for a stimulating environment to showcase your expertise in big data systems? We are seeking a talented Data Engineer/Scientist to join our team at Cloud Counselage Pvt Ltd in Hyderabad, India.We offer a competitive salary range of ₹1,200,000 - ₹1,800,000 per annum, paid leave, and the opportunity to work on...
-
Big Data Engineer
2 weeks ago
Hyderabad, Telangana, India People Tech Group Inc Full timeJob TitleWe are seeking a skilled Big Data Developer to join our team at People Tech Group Inc. as part of our ongoing efforts to expand our services.This role is ideal for individuals with 7+ years of experience in Hadoop Eco System – Spark, Python, Hive, Impala, Unix, Python and OOPs programming languages (Scala preferred), SQL, Hadoop/Spark, Agile...
-
Big Data Engineer, Data Modeling
7 months ago
Hyderabad, India data.ai Remote Work Freelance Full timeWhat can you tell your friends when they ask you what you do? We’re looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...
-
Big Data Engineer
4 months ago
Hyderabad, India NucleusTeq Full timeBig Data Engineer Responsibilities: Big Data Engineer with 5+ years of experienceExperience in leading a team of engineers and a good attitude toward learning the domain and implementationStrong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.Finalizing the scope of the system and delivering...
-
Big Data Engineering Expert
1 week ago
Hyderabad, Telangana, India Burgeon It Services Pvt Ltd Full timeJob Opportunity:Burgeon It Services Pvt Ltd is a dynamic organization that provides software solutions to clients worldwide. We are seeking an experienced Big Data Engineering Expert to join our team in Hyderabad and take on a key role in developing modern and scalable big data applications.Job Description:We are looking for a highly skilled individual with...