Big data engineer
4 weeks ago
Experience in hadoop/big data technologies.
Experience in spark.
Experience working on Google or AWS cloud developing data solutions. Certifications preferred.
Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;
Experience with containerization and related technologies (e.g. Docker, Kubernetes)
Experience with all aspects of Dev Ops (source control, continuous integration, deployments, etc.)
Comprehensive knowledge of the principles of software engineering and data analytics
Advanced knowledge of the Hadoop ecosystem and Big Data technologies Hands-on experience with the Hadoop eco-system (HDFS, Map Reduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)
Knowledge of agile (scrum) development methodology is a plus
Strong development/automation skills
Proficient in programming in Java or Python with prior Apache Beam/Spark experience a plus.
System level understanding - Data structures, algorithms, distributed storage & compute
Can-do attitude on solving complex business problems, good interpersonal and teamwork skills
-
Innovative Big Data Solutions Engineer
2 weeks ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Solutions Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data products components based on requirements with possible technical solutions.You will work closely with Data Scientists, Data Engineers,...
-
Big Data Engineer
3 months ago
Hyderabad, India NucleusTeq Full timeBig Data Engineer Responsibilities: Big Data Engineer with 5+ years of experienceExperience in leading a team of engineers and a good attitude toward learning the domain and implementationStrong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.Finalizing the scope of the system and delivering...
-
Big data engineer
6 months ago
Hyderabad, India Virtusa Full timeBig data engineer - CREQ189284 Description Position: Big data engineer Primary: big data concepts, aws, pyspark Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge...
-
Data Scientist
3 weeks ago
Hyderabad, Telangana, India Virtusa Full timeAbout the Role">Virtusa is seeking an experienced Data Scientist to join our team as a Big Data Engineer. This role will involve designing and implementing data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.">Responsibilities">">Design and implement data processing pipelines using Python programming...
-
Senior Big Data Engineer
2 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeJob DescriptionAbout the Role:We are seeking an experienced Senior Big Data Engineer to join our team at Tata Consultancy Services. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale big data environments using PySpark.Key Responsibilities:Design and implement complex big data...
-
Big Data Engineer
6 months ago
Hyderabad, India TechSophy Full timeJob Description: Roles&Responsibilities : 1. As an Engineer, you are responsible to analyze large data sets to identify errors in the map. 2. As an Engineer, you are responsible to design and implement a complex algorithm for resolving the issue, review the solution with a team of engineers and analysts, and integrate the resulting solution into...
-
Big Data Python Engineer
6 months ago
Hyderabad, India Virtusa Full timeBig Data Python Engineer - CREQ191701 Description Role GDT WS Big Data Python Engineer Exp 5+ Location Pune/Hyderabad MUST Have Skills Design and implement data processing pipelines using Python + SCALA programming and big data technologies such as Hadoop, MapReduce, Hive, and Spark. Airflow Jenkins Understand business requirements to code up data assets...
-
Big data engineer
4 weeks ago
Hyderabad, India Anblicks Full timeExperience- 4+ years Experience in hadoop/big data technologies. Experience in spark. Experience working on Google or AWS cloud developing data solutions. Certifications preferred. Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required; Experience with containerization and related technologies (e.g....
-
Big Data Engineer
1 month ago
hyderabad, India Anblicks Full timeExperience- 4+ years Experience in hadoop/big data technologies. Experience in spark. Experience working on Google or AWS cloud developing data solutions. Certifications preferred. Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required; Experience with containerization and related technologies (e.g. Docker,...
-
AWS Big Data Engineer
6 months ago
Hyderabad, India Tiger Analytics Full timeJob Description We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch...
-
Big Data Engineer
4 weeks ago
hyderabad, India Anblicks Full timeExperience- 4+ yearsExperience in hadoop/big data technologies.Experience in spark.Experience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies (e.g. Docker,...
-
Big Data Engineer
1 month ago
Hyderabad, India Anblicks Full timeExperience- 4+ yearsExperience in hadoop/big data technologies.Experience in spark.Experience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies (e.g. Docker,...
-
Big Data Engineering Lead
3 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeAbout Tata Consultancy ServicesTata Consultancy Services is a leading IT services company that empowers global businesses through its cutting-edge technology and innovative solutions.Compensation PackageThe estimated salary for this role is around $120,000 - $180,000 per annum, depending on the location and individual qualifications.About the RoleJob...
-
Big Data Engineer
1 month ago
Hyderabad, India Anblicks Full timeExperience- 4+ yearsExperience in hadoop/big data technologies.Experience in spark.Experience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies (e.g. Docker,...
-
Big Data Engineer
1 month ago
Hyderabad, India Anblicks Full timeExperience- 4+ yearsExperience in hadoop/big data technologies.Experience in spark.Experience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies (e.g. Docker,...
-
Big Data Engineer
1 month ago
Hyderabad, India Anblicks Full timeExperience- 4+ years Experience in hadoop/big data technologies. Experience in spark. Experience working on Google or AWS cloud developing data solutions. Certifications preferred. Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required; Experience with containerization and related technologies (e.g. Docker,...
-
Big Data Engineer Position
2 weeks ago
Hyderabad, Telangana, India Anblicks Full timeWe are looking for a skilled Big Data Engineer to join our team at Anblicks. This is a full-time opportunity with a competitive salary and excellent benefits.Key Responsibilities:Design, develop, and deploy large-scale data processing systems using Hadoop and Spark technologies.Collaborate with cross-functional teams to identify business requirements and...
-
Big Data Engineer
1 month ago
hyderabad, India UST Full timeJ Dear Candidate , Please share following details over email. To Proceed further . Nitin.patil@ust.com Total Years of Experience – Relevant Experience - Big Data Relevant Experience - hadoop Relevant Experience - Airflow Relevant Experience - Scala in Spark Relevant Experience - Hive Current CTC – Expected CTC – Current Location – Expected Location...
-
Senior Big Data Engineer
2 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeJob Title: Senior Big Data EngineerAbout Us: Tata Consultancy Services, a global leader in IT services and consulting, is seeking an experienced Senior Big Data Engineer to join our team.Estimated Salary: ₹1,200,000 - ₹1,500,000 per annum (dependent on location and experience).Job Description:The successful candidate will have hands-on experience with...
-
Big Data Architect
2 months ago
Hyderabad, India TECHSTAR SOFTWARE DEVELOPMENT INDIA PVT LTD Full timeAbout the Role:The ideal candidate will be responsible for designing and developing scalable big data solutions that drive business growth and improve customer experiences.Key Responsibilities:Design and develop data pipelines for data ingestion and transformation using Java, Scala, or Python.Work with data scientists to build data pipelines using...