Big Data Engineer
4 weeks ago
Job Responsibilities:
• Develop scalable distributed architectures using Apache Spark and Python.
• Design data processing pipelines for batch and real-time analytics on structured and unstructured data.
• Work with stakeholders to ensure end-to-end requirements are addressed.
• Collaborate with the team to adhere to the Software Development Life cycle (SDLC).
• Develop ETL scripts for big data sources and optimize data processing for reports and dashboards.
Requirements:
• Proficiency in Apache Spark and Python programming.
• Experience working with distributed systems, cloud services, and data engineering analytics platforms.
• Strong understanding of data processing at scale, including event-driven systems and message queues.
• Experience with data ingestion tools such as Apache Nifi, Apache Airflow, Sqoop, and Oozie.
• Strong team player with excellent communication skills.
About ATech:
We are a technology company that specializes in developing scalable and efficient data processing solutions. Our team is passionate about working with cutting-edge technologies to deliver innovative solutions to our clients.
-
Big Data Engineer
1 week ago
navi mumbai, India Pert Telecom Solutions Full timeJob Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...
-
Big Data Engineer
1 week ago
Navi Mumbai, India Pert Telecom Solutions Full timeJob Description: We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...
-
Data Engineer
1 month ago
Pune, Maharashtra, India NTT DATA Services Full timeJob Title: Data Engineer - Big Data SpecialistWe are seeking a highly skilled Data Engineer to join our team in Pune, India. As a Data Engineer, you will work on exciting big data related projects that require large data sets to be processed via a vendor sourced solution on a daily, weekly and monthly basis.Key Responsibilities:Analyzing data sets and...
-
Big Data Engineer
1 month ago
Goa/Mumbai/Jammu & Kashmir/Jammu/Srinagar/Pondicherry/Jaipur/Lucknow/Varanasi/Banaras/Patna/Ranchi, India ATech Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at ATech. The successful candidate will be responsible for designing, building, and optimizing data models and ETL processes to support our clients' business requirements.Key Responsibilities:Design and develop scalable Big Data applications and...
-
Big Data Engineer
1 month ago
Pune/Maharashtra, India Talent Sketchers Full timeJob Title: Big Data EngineerAt Talent Sketchers, we are seeking a highly skilled Big Data Engineer to join our team.Key Responsibilities:Design and develop scalable data processing systems using Apache Spark.Work with various programming languages such as Java and Scala.Expertise in database modeling and working with SQL and NoSQL databases.Experience with...
-
Big Data Developer
3 weeks ago
Navi Mumbai, Maharashtra, India Reliance Industries Limited Full timeWe are seeking a highly skilled Big Data Developer to join our team at Reliance Industries Limited. The ideal candidate will have a strong background in data engineering and analytics, with experience in designing and implementing data architectures that meet the needs of large-scale enterprise environments.Key Responsibilities:Collaborate with...
-
Big Data Engineer
1 month ago
Mumbai, Maharashtra, India Snaphunt Full timeThe OpportunityWe are seeking an experienced Big Data Developer to join our team at Snaphunt. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data processing pipelines using Kafka, PySpark, Python/Scala, and Spark.The RoleDesign and implement robust data processing solutions using...
-
Big Data Developer
4 weeks ago
Navi Mumbai, India Reliance Industries Limited Full timeWe are looking for a Big Data Engineer with a mindset to solve complex analytics problem and the ability to use the latest tools and technology and build solutions that are reliable and scalable to work with the size and scope of the company, then we would like to connect with you.Roles & Responsibilities: Participate in design and implementation of the...
-
Senior Big Data Engineer
1 month ago
Mumbai, Maharashtra, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full timeJob Title: Senior Big Data EngineerAbout the Role:We are seeking a highly skilled Senior Big Data Engineer to join our team at AEXONIC TECHNOLOGIES PRIVATE LIMITED. The successful candidate will be responsible for designing, building, and maintaining robust data pipelines that support large-scale data processing and analytics.Key Responsibilities:- Design,...
-
Big Data Engineer
5 days ago
Coimbatore, Chennai, India Talodyn Networks Private Limited Full timeDescriptionWe are seeking a highly skilled Big Data Engineer with 5-9 years of experience to join our team in India. The ideal candidate should have a strong technical background in big data technologies and be able to design, develop, and maintain large-scale data processing systems. The candidate should also be able to work collaboratively with...
-
Data Engineer for Cloud and Big Data Ecosystem
2 weeks ago
Navi Mumbai, Maharashtra, India Jio Full timeAt Jio, we are seeking a skilled Data Engineer to join our team in the OTT Media Operations department.We are looking for an experienced professional with a strong background in Application Operations support, particularly in the Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, Storm, Flink, Kafka). The ideal candidate will have hands-on experience...
-
Big Data Support Engineer
4 weeks ago
Navi Mumbai, Maharashtra, India Jio Full timeAbout the Role: We are seeking a highly skilled Senior Hadoop Operations Engineer to join our team at Jio, where you will play a key role in ensuring the smooth operation of our big data infrastructure.Key Responsibilities:Big Data Infrastructure Management: You will be responsible for managing and maintaining our Hadoop cluster, including configuring and...
-
Data Engineer
3 weeks ago
Pune, Maharashtra, India Virtusa Full timeAbout the RoleAt Virtusa, we are seeking a highly skilled Data Engineer (Big Data) to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Apache Spark, Hadoop, and Hive.Responsibilities• Design, develop, and...
-
Big Data Architect
6 months ago
Mumbai, Maharashtra, India Robosoft Technologies Full timeJob Description: At Robosoft, we're passionate about building solutions that solves problems. We count on Big Data Architects who are primary helping us design large data solution from high level to low level keeping cost and performance in consideration. Our customers look for solution which can help them build intelligent analytical platform and support...
-
Big Data Engineer
1 month ago
Pune, India SGS Technical Services Pvt. Ltd Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at SGS Technical Services Pvt. Ltd. The successful candidate will be responsible for designing, developing, and maintaining scalable data processing systems using Hadoop and PySpark.Key Responsibilities:Design and develop data processing systems using...
-
Big Data Engineer
3 weeks ago
Coimbatore, Tamil Nadu, India LION AND ELEPHANTS Full timeJob Title: Big Data DeveloperWe are seeking a skilled big data developer with strong expertise in Scala, Spark & HDFS. The ideal candidate will have a strong background in big data processing.Key Responsibilities:- Develop and maintain data processing applications using Spark and Scala.- Hands-on development in Scala, Spark, and HDFS platforms.- Collaborate...
-
Big Data Engineer
1 week ago
Coimbatore, Tamil Nadu, India LION AND ELEPHANTS Full timeJob Title : Big Data DeveloperWe are seeking a skilled big data developer with strong expertise in Scala, Spark & HDFS.The ideal candidate will have a strong background in big data processing.Develop and maintain data processing applications using Spark and Scala.Hands-on development in Scala, Spark, and HDFS platforms.Collaborate with cross-functional teams...
-
Big Data Developer
3 weeks ago
Mumbai, Maharashtra, India Pegasus InfoCorp Full timeAbout the Role:Pegasus InfoCorp is seeking a highly skilled Big Data Developer to join our team.As a Big Data Developer, you will be responsible for building solutions for customers using Big Data technologies. You will work on designing, developing, and implementing Big Data solutions that meet our customers' needs. You will also be responsible for...
-
Big Data Engineer
1 month ago
Chennai/Hyderabad/Bangalore/Coimbatore/Mumbai/Delhi/Pune, India GAIUS HYPERLOCAL PRIVATE LIMITED Full timeJob Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at GAIUS HYPERLOCAL PRIVATE LIMITED. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable and efficient big data solutions.Key Responsibilities:Design and develop scalable big data architectures and pipelines.Develop...
-
Big Data Engineer
4 weeks ago
Mumbai, Maharashtra, India Nibodhah Full timeJob SummaryNibodhah is seeking an experienced Big Data Engineer to develop and implement data pipelines that extract, transform, and load data into an information product that informs the organization in reaching strategic goals.Key ResponsibilitiesDevelop and maintain data pipelines implementing ETL processesBuild, operate, monitor, and troubleshoot Hadoop...