Senior Big Data Engineer
1 day ago
About the Role:
We are seeking an experienced Senior Big Data Engineer to join our team at Tata Consultancy Services. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale big data environments using PySpark.
Key Responsibilities:
- Design and implement complex big data pipelines using PySpark, including DataFrames, Spark SQL, and Spark Streaming.
- Develop and maintain high-performance, scalable big data applications using Hadoop, Hive, Kafka, YARN, HBase, and MongoDB.
- Work with cross-functional teams to design and implement data warehouses, data lakes, and other data infrastructure components.
- Collaborate with data scientists and analysts to develop data products and services that meet business needs.
Requirements:
- Minimum 5 years of experience in big data engineering with PySpark, Hadoop, Hive, Kafka, YARN, HBase, and MongoDB.
- Hands-on experience in generating/parsing XML, JSON documents, and REST API requests/responses.
- Expertise in handling complex large-scale big data environments.
- Excellent communication and analytical skills.
Desired Qualifications:
- Familiarity with AWS Glue and cloud-based big data platforms.
- Experience in Agile methodology using JIRA.
- Knowledge of investment functional domain.
What We Offer:
- A competitive salary range of ₹1,200,000 - ₹1,800,000 per annum based on your experience and qualifications.
- A comprehensive benefits package, including health insurance, retirement savings plan, and paid time off.
- The opportunity to work with a leading global IT services company and contribute to exciting big data projects.
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India data Full timeOverview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...
-
Senior Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Vidpro Consultancy Services Full timeJob Title: Senior Big Data EngineerJob Summary: Vidpro Consultancy Services is seeking a highly skilled Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale big data architectures using Java, Python, and Hadoop technologies.Responsibilities:Design...
-
Senior Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Findernest Software Services Pvt Ltd Full timeAbout the RoleWe are seeking a highly skilled Senior Big Data Engineer to join our team at Findernest Software Services Pvt Ltd. As a Senior Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable big data solutions that drive business growth and decision-making.Key ResponsibilitiesDesign and implement big data...
-
Senior Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Nisum Full timeJob Title: Senior Big Data EngineerAbout the Role:We are seeking a highly skilled Senior Big Data Engineer to join our team at Nisum. As a key member of our engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems using Hadoop, Python, and other big data technologies.Key Responsibilities:- Design...
-
Innovative Big Data Solutions Engineer
15 hours ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Solutions Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data products components based on requirements with possible technical solutions.You will work closely with Data Scientists, Data Engineers,...
-
Big Data Systems Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeJob Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...
-
Senior Big Data Engineer
1 month ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Senior Big Data EngineerJob Summary:We are seeking a Senior Big Data Engineer to join our team at Virtusa. The ideal candidate will have a strong background in designing, building, and supporting data applications using Spark, Sqoop, and Hive.Key Responsibilities:Design and develop complex data applications using Spark, Sqoop, and Hive.Work with...
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Services Full timeData Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...
-
Senior Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India SPG Consulting Full timeAt SPG Consulting, we are seeking a highly skilled and experienced Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be working on designing, building, and maintaining large-scale distributed systems using Scala and Spark.Key Responsibilities:Design and develop high-performance, scalable, and fault-tolerant...
-
Senior Big Data Engineer Position
2 weeks ago
Hyderabad, Telangana, India Rightpath Computer Technologies Pvt Ltd Full timeJob OverviewWe are seeking a highly skilled Senior Big Data Engineer to join our team at Rightpath Computer Technologies Pvt Ltd. This is a challenging role that requires expertise in designing, building, and maintaining large-scale data processing systems.
-
Data Engineer for Big Data Concepts
3 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Senior Data Platform EngineerJob Summary:Job Description: We are seeking a talented Senior Data Platform Engineer to join our team at Virtusa. As a Senior Data Platform Engineer, you will be responsible for designing, developing, and maintaining large-scale data platforms using Python. You will work closely with cross-functional teams to...
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India ANB IT Solutions Pvt Ltd Full timeKey ResponsibilitiesCollaborate with cross-functional teams to design, develop, and maintain big data solutions using Google Cloud Big Query. Key responsibilities include data ingestion, transformation, and analytics.Data Engineering and DevelopmentDevelop and maintain ETL/ELT processes to ensure data integrity and consistency. Utilize Google Cloud Composer,...
-
Big Data Engineer
1 month ago
Hyderabad, Telangana, India TechSophy Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TechSophy. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Analyze large data sets to identify errors in the map.Design and implement complex...
-
Senior Backend Engineer
4 weeks ago
Hyderabad, Telangana, India AUGUS IT SOLUTIONS Full time**Job Overview**We are seeking an experienced Senior Backend Engineer to lead the development of our Big Data Analytics platform. As a Senior Backend Engineer, you will be responsible for designing and implementing scalable, efficient, and robust solutions using Python and Django/Flask frameworks.**Responsibilities**Design and develop Python-based...
-
Key Senior Software Engineer
4 weeks ago
Hyderabad, Telangana, India Orbcomm Full timeAchieve a Significant Impact with Our Senior Software Engineer - Big Data RoleWe are on the hunt for a passionate Senior Software Engineer - Big Data who thrives in a fast-paced, agile setting. As a key member of our Big Data team, you will coordinate the development of various data-driven features and products that drive our cutting-edge solutions.Why...
-
Senior Software Engineer
3 weeks ago
Hyderabad, Telangana, India Orbcomm Full timeTransformative Opportunity: Senior Software Engineer - Big Data In a world of data-driven decision making, we're on the hunt for a visionary Senior Software Engineer - Big Data who can propel our cutting-edge solutions forward. What You'll Do: Lead the development of scalable analytics solutions using AWS cloud services, driving innovation and growth....
-
Senior Software Architect
1 month ago
Hyderabad, Telangana, India Orbcomm Full timeTransform Data into Insights as a Senior Software Architect - Big DataWe're seeking a seasoned Senior Software Architect - Big Data to lead the design and development of scalable data architectures for processing large volumes of streaming data. As a key member of our Big Data team, you'll collaborate with data engineers to build and optimize data pipelines...
-
Big Data Engineering Professional
2 weeks ago
Hyderabad, Telangana, India TEKNIKOZ Full timeWe are seeking a highly skilled Big Data Engineering Professional to join our team at TeknikoZ.As a Senior Associate L2 in Data Engineering, you will be responsible for translating client requirements into technical design and implementing components for data engineering solutions.You will utilize your deep understanding of data integration and big data...
-
GCP Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India Tiger Analytics Full timeAbout the Role:Tiger Analytics is looking for a Senior Data Engineer to join our Chennai office. As a Senior Data Engineer, you will be responsible for designing and building solutions for near real-time stream processing and batch processing on the Big Data platform.Responsibilities:Design and build solutions for near real-time stream processing and batch...
-
Senior Big Data Architecture Lead
5 days ago
Hyderabad, Telangana, India Orbcomm Full timeTransformative Opportunity for a Senior Big Data Architecture LeadWe are seeking an exceptional individual to lead our big data architecture initiatives, driving innovation and excellence in our IoT technology solutions.About the Role:As a Senior Big Data Architecture Lead at ORBCOMM, you will be responsible for designing and developing scalable data...