Senior Big Data Engineer
2 weeks ago
About the Role
We are seeking an experienced Senior Big Data Engineer to work on collecting, storing, processing, and analyzing large data sets in our Bangalore, Chennai, Kolkata, Gurugram, Pune office.
The ideal candidate will have a strong understanding of data warehousing and data modeling techniques, proficient knowledge of distributed computing principles, and hands-on experience with GCP platforms, including Airflow, Cloud Composer, Data Fusion, Data Flow, Data Proc, BigQuery.
Key Responsibilities
- Selecting and integrating Big Data tools and frameworks to provide requested capabilities.
- Developing and maintaining data pipelines, implementing ETL processes, monitoring performance, and advising on necessary infrastructure changes.
- Translating complex technical and functional requirements into detailed designs.
- Investigating and analyzing alternative solutions for data storage, processing, etc., to ensure the most streamlined approaches are implemented.
Requirements
- Strong understanding of data warehousing and data modeling techniques.
- Proficient understanding of distributed computing principles.
- Hands-on experience with GCP platforms, including Airflow, Cloud Composer, Data Fusion, Data Flow, Data Proc, BigQuery.
- Experience with building stream-processing systems, using solutions such as Storm or Spark Streaming.
- Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala.
- Experience with Spark, SQL, and Linux.
- Knowledge of various ETL techniques and frameworks, such as Flume, Apache NiFi, or DBT.
- Experience with messaging systems like Kafka or RabbitMQ.
What We Offer
- An estimated salary of ₹1200000 - ₹1800000 per annum.
- A dynamic and challenging work environment.
- Ongoing training and professional development opportunities.
-
Senior Big Data Engineer
2 weeks ago
Gurgaon, Haryana, India Arrixa Full timeArrixa is seeking an experienced Senior Big Data Engineer to lead the design and implementation of our big data solutions on Azure Databricks. This role requires a strong background in big data technologies, including Apache Spark, and experience working with large-scale data processing pipelines.About ArrixaArrixa is a leading provider of innovative...
-
Gurgaon, Haryana, India BayOne Solutions Full timeJob Title: Senior Cloud Data Engineer for Big Data SolutionsAbout BayOne SolutionsBayOne Solutions is a 12-year-old software consulting organization based in Pleasanton, California, USA. We specialize in providing talent and solutions, with a passion for diversity in tech.Job OverviewWe are seeking an experienced Senior Cloud Data Engineer to join our team....
-
Senior Big Data Solutions Architect
1 month ago
Gurgaon, Haryana, India SMARTWORK IT SERVICES Full timeJob Title: Senior Big Data Solutions ArchitectJob Summary:We are seeking a skilled Senior Big Data Solutions Architect to join our team at SMARTWORK IT SERVICES. As a Senior Big Data Solutions Architect, you will be responsible for designing and implementing scalable big data solutions to meet the ever-growing needs of our clients.Key...
-
Senior Big Data Architect
3 weeks ago
Gurgaon, Haryana, India Impetus Technologies Full timeImpetus Technologies is seeking a Senior Big Data Architect to lead our PySpark development team.Salary: $150,000 - $200,000 per yearJob Description:We are looking for an experienced professional with a strong background in Big Data technologies, particularly PySpark, Hadoop, and Hive. The ideal candidate will have 5-7 years of hands-on experience in...
-
Data Architect
2 days ago
Gurgaon, Haryana, India Impetus Full timeJob SummaryWe are seeking a skilled Data Architect - Big Data Engineer to join our team at Impetus. As a key member of our data engineering team, you will design, develop, and implement efficient ETL pipelines using big data technologies.About the RoleDevelop scalable and secure data pipelines using Hadoop, Hive, and PySpark.Collaborate with cross-functional...
-
Gurgaon, Haryana, India AIDA projektai, MB Full timeJob Description:We are seeking a highly skilled Senior Real-Time Data Engineer to join our team at AIDA projektai, MB. This role is ideal for someone with strong expertise in working with big data and hands-on experience in managing and deploying real-time data streaming pipelines.Key Responsibilities:Design, implement, and manage real-time data streaming...
-
Gurgaon, Haryana, India PAR Tech India Full timeJob OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at PAR Tech India. As a Senior Data Engineer, you will play a critical role in shaping Punchh's data innovations and creating cutting-edge big data solutions.Estimated Salary: ₹33 Lakhs - ₹35 Lakhs per annum (commensurate with work location, experience, skills,...
-
Cloud Architect for Big Data Applications
3 weeks ago
Gurgaon, Haryana, India The Nielsen Company Full timeSenior/Lead Software Engineer Position OverviewWe are seeking an experienced Senior/Lead Software Engineer to join our DevOps team at The Nielsen Company. In this role, you will be responsible for analyzing, developing, testing, and supporting Big Data applications.
-
Senior Data Engineer
1 week ago
Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full timeJob OverviewSpectral Consultants is seeking an experienced Big Data Developer to join our team.About the RoleWe are looking for a skilled professional with expertise in building scalable and efficient data pipelines using Big Data technologies such as Hive, Spark, Hadoop, and MapReduce.Key ResponsibilitiesDesign, implement, and optimize large-scale data...
-
Data Engineer
3 weeks ago
Gurgaon, Haryana, India exl Full timeJob DescriptionWe are seeking a skilled Data Engineer to join our team as a Big Data Architect. This is an exciting opportunity to work with cutting-edge technology and contribute to the design and implementation of large-scale data processing systems.About EXLEXL (NASDAQ:EXLS) is a leading operations management and analytics company that helps businesses...
-
Senior Software Engineer
1 week ago
Gurgaon, Haryana, India AMEX Full timeAt American Express, we're committed to being the best at what we do. That's why we're looking for a seasoned Senior Software Engineer to join our team.We offer a competitive salary of $120,000 per year, plus bonus incentives and comprehensive benefits, including medical, dental, vision, life insurance, and disability coverage. You'll also have access to...
-
Data Engineer for Big Data Analytics
6 days ago
Gurgaon, Haryana, India Myananta Technologies Full timeMyananta Technologies is a leading technology firm based in Gurugram, India.We are seeking an experienced Data Engineer to join our team and help us drive innovation in big data analytics.About the Role:We are looking for a highly skilled individual with expertise in Hadoop, Spark, Hive, and Airflow. The successful candidate will have extensive experience in...
-
Big Data Solutions Developer
2 weeks ago
Gurgaon, Haryana, India Aays Full timeAbout UsAays is a cutting-edge company at the forefront of innovation, dedicated to harnessing the power of data to drive business growth.Salary and BenefitsWe offer an attractive salary range of $120,000 - $180,000 per annum, along with a comprehensive benefits package that includes health insurance, retirement plans, and generous paid time off.Job...
-
Senior Big Data Developer
1 week ago
Gurgaon, Haryana, India NITS Solutions Full timePosition Overview :We are seeking an Associate Big Data Engineer to join our team at NITS Solutions. The ideal candidate will have hands-on experience with Python, SQL, and POSTGRESQL, as well as a basic understanding of Pandas, Pyspark, and ETL processes.Key Responsibilities :Understand business needs and apply analytical concepts to generate actionable...
-
Cloud Data Engineer for Azure and Big Data
1 week ago
Gurgaon, Haryana, India BayOne Solutions Full timeAre you a seasoned data engineer looking for a new challenge? BayOne Solutions is seeking an experienced Cloud Data Engineer to join our team. With a strong background in modern data engineering, data warehousing, and data lakes technologies on cloud platforms like Azure, AWS, and GCP, this role is perfect for those who want to work with cutting-edge...
-
Big Data Software Engineer for Nielsen
1 week ago
Gurgaon, Haryana, India Nielsen Full timeAt Nielsen, we're driven by a passion to revolutionize the media landscape and empower informed decision-making. As a Senior Software Engineer-AM-TECH-DA-DC-11 on our team, you'll play a pivotal role in shaping the future of data-driven insights.About the RoleWe're seeking an exceptional Big Data Software Engineer to join our DevOps team. Your primary...
-
Cloud Engineer
3 weeks ago
Gurgaon, Haryana, India The Nielsen Company Full timeWe are looking for a seasoned Cloud Engineer with expertise in Big Data technologies to join our team at The Nielsen Company. This role is perfect for someone who wants to leverage their passion for cloud architecture and big data processing to drive business growth.Job DescriptionThis is an exciting opportunity to work on complex projects that involve...
-
Big Data Architect
1 week ago
Gurgaon, Haryana, India dunnhumby Full timeAbout Usdunnhumby is a market-leading business that explores new opportunities for global retailers.We're looking for a Big Data Architect who expects more from their career. It's a chance to extend and improve our Data Engineering Team and influence our technology strategy and data principles.You will be responsible for working with stakeholders in the...
-
Cloud Architect Engineer for Big Data Solutions
2 weeks ago
Gurgaon, Haryana, India Nielsen Full timeAre you a talented software engineer looking to make an impact in the media industry? We have an exciting opportunity for a Cloud Architect Engineer for Big Data Solutions at Nielsen, a global leader in providing powerful insights that drive client decisions and deliver extraordinary results.About UsWe are passionate about our work to power a better media...
-
Senior Data Engineering Manager
2 weeks ago
Gurgaon, Haryana, India Metyis Full timeJob SummaryWe are seeking a highly skilled Senior Data Engineering Lead to join our team at Metyis. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data processing solutions.About the RoleThe ideal candidate will have 7+ years of experience in managing and leading data engineering projects,...