Big Data Engineer
2 months ago
We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.
To ensure success as a big data engineer, you should have in-depth knowledge of Hadoop technologies, excellent project management skills, and high-level problem-solving skills. A top-notch Big Data Engineer understands the needs of the company and institutes scalable data solutions for its current and future needs.
Responsibilities :
- Meeting with managers to determine the company's Big Data needs.
- Developing Hadoop systems.
- Loading disparate data sets and conducting pre-processing services using Hive or Pig.
- Finalizing the scope of the system and delivering Big Data solutions.
- Managing the communications between the internal system and the survey vendor.
- Collaborating with the software research and development teams.
- Building cloud platforms for the development of company applications.
- Maintaining production systems.
- Training staff on data resource management.
Requirements :
- Bachelor's degree in computer engineering or computer science.
- 5+Years experience as a Big data engineer.
- In-depth knowledge of Hadoop, Spark, and similar frameworks.
- Knowledge of scripting languages including Java, C++, Linux, Ruby, PHP, Python, and R.
- Knowledge of NoSQL and RDBMS databases including Redis and MongoDB.
- Familiarity with AWS, and Docker tools.
- Excellent project management skills.
- Good communication skills.
- Ability to solve complex networking, data, and software issues.
-
Data Engineer
1 month ago
Pune, Maharashtra, India NTT DATA Services Full timeJob Title: Data Engineer - Big Data SpecialistWe are seeking a highly skilled Data Engineer to join our team in Pune, India. As a Data Engineer, you will work on exciting big data related projects that require large data sets to be processed via a vendor sourced solution on a daily, weekly and monthly basis.Key Responsibilities:Analyzing data sets and...
-
Data Engineer
3 weeks ago
Pune, Maharashtra, India Virtusa Full timeAbout the RoleAt Virtusa, we are seeking a highly skilled Data Engineer (Big Data) to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Apache Spark, Hadoop, and Hive.Responsibilities• Design, develop, and...
-
Senior Big Data Developer
1 week ago
Pune, Maharashtra, India NTT DATA Full timeCompany OverviewNTT DATA is a global technology services company that helps clients innovate, optimize and transform for long term success. We have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our Commitment to YouEstimated Salary: ₹2,200,000 - ₹3,500,000 per annum (dependent on...
-
Senior Big Data Engineer
4 weeks ago
Pune, Maharashtra, India Virtusa Full timeAbout the RoleAt Virtusa, we are looking for a skilled Senior Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark, Hadoop, Hive, and Impala.Key Responsibilities• Develop and implement data pipelines using...
-
Big Data Engineer
4 weeks ago
Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full timeJob SummaryF337 Deutsche India Private Limited, Pune Branch is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Scala technologies.Key ResponsibilitiesDesign and develop data processing pipelines using...
-
Data Engineer
3 weeks ago
Pune, Maharashtra, India NR Consulting - India Full timeJob Title: Data Engineer - Java and Big DataJob Description:Data Engineer - Java and Big DataPython – advanced concepts (add on if candidate have Java background)Problem SolvingHadoop/Spark/HiveKafkaSpring Boot PL/SQL – derive a pseudocode, write a queryAbout the Role:This role requires a strong background in Java and Big Data technologies. The ideal...
-
Big Data Engineer
1 month ago
Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full timeAbout the RoleF337 Deutsche India Private Limited, Pune Branch is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Scala technologies.Key ResponsibilitiesDesign and develop data processing pipelines using...
-
Big Data Engineer/Manager
4 weeks ago
Pune, Maharashtra, India Huquo Full timeJob Overview :Huquo is seeking a highly skilled Data Architect and Engineer to lead our data engineering team. As a key member of our team, you will design and implement scalable, secure, and high-performance data architectures.Key Responsibilities :Design and develop data pipelines using Hadoop, Spark, and other big data technologies.Collaborate with...
-
Data Engineer Lead
3 weeks ago
Pune, Maharashtra, India DATAECONOMY Full timeJob Profile:At DATAECONOMY, we are seeking a highly skilled Data Engineer Lead to lead our team in designing and implementing big data solutions using PySpark. As a key member of our team, you will be responsible for collaborating with cross-functional teams to understand business needs and develop data-driven solutions.Key Responsibilities:Design and...
-
Senior Data Engineer
1 month ago
Pune, Maharashtra, India Data Axle Full timeAbout Data AxleData Axle Inc. is a leading provider of data, marketing solutions, sales, and research. With a 50-year history in the US, the company has established a strategic global centre of excellence in Pune, delivering mission-critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...
-
Scalable Big Data Engineer
1 day ago
Pune, Maharashtra, India Virtusa Full timeJob Title: Scalable Big Data EngineerAbout the RoleVirtusa is seeking an experienced Scala and Spark Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Scala and Spark.Key Responsibilities- Design and develop scalable big data...
-
Data Engineer
3 weeks ago
Pune, Maharashtra, India NTT DATA Full timeJob Title:Data EngineerJob Summary:NTT DATA is seeking a Data Engineer to join our team in Pune, India. The successful candidate will have demonstrable experience and expertise in at least one programming language, whether it's Python, Java, Scala, or another technology. We value attitude and aptitude and are seeking bright, highly motivated individuals to...
-
Data Engineer Leader
3 weeks ago
Pune, Maharashtra, India DATAECONOMY Full timeAbout the RoleDataEconomy is seeking a Senior Data Engineer to lead our team in designing and implementing big data solutions using PySpark.Key ResponsibilitiesLead the design and implementation of scalable and robust data pipelines using PySpark.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Mentor and...
-
Big Data Engineer
3 weeks ago
Pune, Maharashtra, India PRI Global Full timeJob Title: Big Data Engineer - Data Migration SpecialistJob Summary: We are seeking a highly skilled Big Data Engineer to join our team at PRI Global. As a Big Data Engineer - Data Migration Specialist, you will be responsible for migrating data from HDFS to Ozone, ensuring seamless data transfer and minimizing downtime.Key Responsibilities:Migrate data from...
-
Senior Big Data Engineer
4 weeks ago
Pune, Maharashtra, India Xoriant Full timeJob OverviewXoriant is seeking a highly skilled Senior Big Data Engineer to join our team. The ideal candidate will have expertise in Apache Spark and Scala, with a strong background in big data processing and analytics.Key ResponsibilitiesDesign and develop scalable big data architectures using Apache SparkDevelop and maintain high-performance data...
-
Senior Data Engineer
4 weeks ago
Pune, Maharashtra, India Data Axle Full timeAbout Data AxleData Axle Inc. has been a leading provider of data, marketing solutions, sales, and research for over five decades in the US. Our global centre of excellence in Pune delivers mission-critical data services to our customers worldwide, leveraging our proprietary cloud-based technology platform and business & consumer databases.Job SummaryWe are...
-
Senior Data Engineer
4 weeks ago
Pune, Maharashtra, India Data Axle Full timeAbout Data Axle Data Axle Inc. has been a leading provider of data, marketing solutions, sales and research for decades in the US. We have established a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers through our proprietary cloud-based technology platform and leveraging our proprietary...
-
Big Data Cloud Engineer
4 weeks ago
Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full timeAbout the RoleWe are seeking a motivated Big Data Cloud Engineer to join our team at F337 Deutsche India Private Limited, Pune Branch. This role will be part of the Technology, Data and Innovation (TDI) department, working on the central client reference data system in Germany.Key ResponsibilitiesDesign and implement big data solutions using Cloudera,...
-
Senior Big Data Engineer
3 weeks ago
Pune, Maharashtra, India PubMatic Full timeWe are seeking a highly skilled Senior Big Data Engineer to join our team at PubMatic-Pune.Key Responsibilities:Design, implement, and deliver complex, scalable, and resilient big data platforms and services.Develop and maintain high-throughput big data platforms using modern technology stacks such as Apache Spark, Apache Kafka, and Hadoop.Collaborate with...
-
Big Data Engineer
2 months ago
Pune, Maharashtra, India Mig Staffing Full timeJob Description : We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production :- Meeting with managers to...