Big Data Engineer
3 weeks ago
Job Summary:
We are seeking a highly skilled Big Data Engineer to join our team at SGS Technical Services Pvt. Ltd. The successful candidate will be responsible for designing, developing, and maintaining scalable data processing systems using Hadoop and PySpark.
Key Responsibilities:
- Design and develop data processing systems using Hadoop and PySpark.
- Implement data pipelines to process large datasets efficiently.
- Work with data warehousing solutions to ensure proper storage and retrieval of data.
- Perform ETL tasks and optimize performance for data ingestion and transformation.
- Collaborate with data scientists, analysts, and other stakeholders to meet business objectives.
- Ensure data security and integrity during processing and storage.
Requirements:
- Strong experience with Hadoop ecosystem (HDFS, MapReduce, HBase, Hive, Pig, etc.).
- Hands-on experience in developing and optimizing large-scale data processing using PySpark.
- Experience with data ingestion, processing, and storage in distributed systems.
- Knowledge of data warehousing concepts and tools.
- Familiarity with cloud platforms like AWS, GCP, or Azure for Big Data solutions.
- Proficiency in SQL and NoSQL databases.
- Understanding of CI/CD pipelines for Big Data applications.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Excellent problem-solving skills and ability to handle large datasets efficiently.
-
Data Engineer
3 weeks ago
Pune, Maharashtra, India NTT DATA Services Full timeJob Title: Data Engineer - Big Data SpecialistWe are seeking a highly skilled Data Engineer to join our team in Pune, India. As a Data Engineer, you will work on exciting big data related projects that require large data sets to be processed via a vendor sourced solution on a daily, weekly and monthly basis.Key Responsibilities:Analyzing data sets and...
-
Big Data Engineer
3 weeks ago
Pune, Maharashtra, India Seven N Half Full timeJob Title: Lead Big Data DeveloperThis is an exciting opportunity to join our team at Seven N Half as a Lead Big Data Developer. We are a fast-paced software company that partners with innovative B2B and B2C SaaS companies for their digital transformation needs.Job Summary:We are seeking a highly skilled and experienced Big Data Developer to lead our team in...
-
Data Engineer
3 days ago
Pune, Maharashtra, India Virtusa Full timeAbout the RoleAt Virtusa, we are seeking a highly skilled Data Engineer (Big Data) to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Apache Spark, Hadoop, and Hive.Responsibilities• Design, develop, and...
-
Senior Big Data Engineer
3 weeks ago
Pune, Maharashtra, India Circana Full timeJob DescriptionCircana is seeking a highly skilled Senior Big Data Engineer to lead our big data initiatives and drive innovation in data engineering.Key ResponsibilitiesDesign and develop scalable big data architectures using Hadoop and Spark frameworks.Lead a team of data engineers to develop and deploy big data solutions.Collaborate with cross-functional...
-
Data Engineer
3 months ago
Pune, India Rao Career Solutions Full timeJob Summary :- We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong expertise in building data pipelines, working with big data technologies like Apache Hive and Parquet, and handling diverse data use cases. You will work closely with data...
-
Big Data Engineer
3 weeks ago
Pune/Maharashtra, India Talent Sketchers Full timeJob Title: Big Data EngineerAt Talent Sketchers, we are seeking a highly skilled Big Data Engineer to join our team.Key Responsibilities:Design and develop scalable data processing systems using Apache Spark.Work with various programming languages such as Java and Scala.Expertise in database modeling and working with SQL and NoSQL databases.Experience with...
-
Big Data Engineer
1 month ago
Pune, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full timeJob Summary:We are seeking a skilled and innovative Big Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data processing systems. You will work with large datasets and implement data pipelines to ensure data quality and availability for analytics and business intelligence...
-
Big Data Engineer/Manager
3 weeks ago
Pune, Maharashtra, India Huquo Full timeJob Title: Big Data Engineer/ManagerAbout the Role:We are seeking a highly skilled Big Data Engineer/Manager to join our team at Huquo. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and NoSQL databases.Key...
-
Senior Big Data Engineer
1 week ago
Pune, Maharashtra, India Virtusa Full timeAbout the RoleAt Virtusa, we are looking for a skilled Senior Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark, Hadoop, Hive, and Impala.Key Responsibilities• Develop and implement data pipelines using...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full timeJob SummaryF337 Deutsche India Private Limited, Pune Branch is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Scala technologies.Key ResponsibilitiesDesign and develop data processing pipelines using...
-
Big Data Engineer
2 weeks ago
Chennai/Pune, India Pan Asia Man power Consultants Recruiting agency Full timeBig Data EngineerWe are seeking a skilled Big Data Engineer to contribute to building backend data applications and services. This role requires expertise in various technologies to drive our data initiatives.Key Responsibilities:Design, develop, and maintain backend data applications and services.Collaborate with product owners and team members to gather...
-
Data Engineer
4 days ago
Pune, Maharashtra, India NR Consulting - India Full timeJob Title: Data Engineer - Java and Big DataJob Description:Data Engineer - Java and Big DataPython – advanced concepts (add on if candidate have Java background)Problem SolvingHadoop/Spark/HiveKafkaSpring Boot PL/SQL – derive a pseudocode, write a queryAbout the Role:This role requires a strong background in Java and Big Data technologies. The ideal...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full timeAbout the RoleF337 Deutsche India Private Limited, Pune Branch is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Scala technologies.Key ResponsibilitiesDesign and develop data processing pipelines using...
-
Big Data Engineer
3 weeks ago
Pune/Gurgaon/Gurugram, India Huquo Full timeJob Title: Big Data EngineerAt Huquo, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable data pipelines using Spark and other big data...
-
Big Data Engineer
3 weeks ago
Chennai/Pune, India Pan Asia Man power Consultants Recruiting agency Full timeJob Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team and contribute to building backend data applications and services that support our analytics platforms.Key Responsibilities:Design, develop, and maintain backend data applications and services.Collaborate with product owners and team members to gather requirements and...
-
Big Data Engineer
3 weeks ago
Chennai/Pune, India Pan Asia Man power Consultants Recruiting agency Full timeJob Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team and contribute to building backend data applications and services that support our analytics platforms.Key Responsibilities:Design, develop, and maintain backend data applications and services.Collaborate with product owners and team members to gather requirements and...
-
Big Data Engineer
3 weeks ago
Hyderabad/Pune/Delhi NCR, India Ace Recruit Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Ace Recruit. As a Big Data Engineer, you will be responsible for designing and building scalable data ingestion pipelines, conceptualizing and executing high-performance data processing, and scheduling and orchestrating pipelines.Key...
-
Big data engineer
2 days ago
Pune, India PRI Global Full timePosition: Sr. Big Data Engineer (Support Role) HM: Kruna Bharti Location: Pune Team/Key Projects: Play4 Initiative for Data and Analytics Duration: 12 Months Initially Domain: Banking and payment preferred YOE: 5+ Years Shift: 12 – 9 PM IST (2 – 3 hours overlap with US Team) Daily Task: Migrating data from HDFS to Ozone ...
-
Big Data Engineer/Manager
2 weeks ago
Pune, Maharashtra, India Huquo Full timeJob Overview :Huquo is seeking a highly skilled Data Architect and Engineer to lead our data engineering team. As a key member of our team, you will design and implement scalable, secure, and high-performance data architectures.Key Responsibilities :Design and develop data pipelines using Hadoop, Spark, and other big data technologies.Collaborate with...
-
Senior Data Engineer
3 weeks ago
Pune, Maharashtra, India Data Axle Full timeAbout Data Axle:Data Axle Inc. has been a leading provider of data, marketing solutions, sales, and research for 50 years in the US. With a strategic global centre of excellence in Pune, Data Axle delivers mission-critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary business &...