Associate Principal – Data Engineering
3 weeks ago
As an Associate Principal – Data Engineering, you’ll have an opportunity to work on the universe of data and solve some very interesting problems by creating and maintaining scalable data pipelines dealing with petabytes of data. All our projects entail working on cutting edge technologies, petabyte scale data processing systems, data warehouses and data lakes to help manage the ever-growing information needs of our customers.
The responsibilities are detailed as below:
• Experience in understanding and translating data, analytic requirements and functional needs into technical requirements while working with global customers
• Build and maintain data pipelines to support large scale data management in alignment with data strategy and data processing standards
• Strong experience in database, data warehouse & data lake design & architecture
• Able to train & mentor team members
• Experience in Database programming using multiple flavor of SQL
• Deploy scalable data pipelines for analytical needs
• Experience in Big Data ecosystem - on-prem (Hortonworks/MapR) or Cloud (Dataproc/EMR/HDInsight)
• Worked on query languages/tools such as Hadoop, Pig, SQL, Hive, Sqoop and SparkSQL.
• Experience in any orchestration tool such as Airflow/Oozie for scheduling pipelines
• Exposure to latest cloud ETL tools such as Glue/ADF/Dataflow
• Understand and execute IN memory distributed computing frameworks like Spark (and/or DataBricks) and its parameter tuning, writing optimized queries in Spark
• Hands-on experience in using Spark Streaming, Kafka and Hbase
• Experience in any orchestration tool such as Airflow/Oozie
• Experience working in an Agile/Scrum development process
REQUIRED QUALIFICATIONS
We are looking for individuals who are curious, excited about learning, and navigating through the uncertainties and complexities that are associated with growing a company. Some qualifications that we think would help you thrive in this role are:
•BE/BS/MTech/MS in computer science or equivalent work experience.
• 10+ years of experience in building data processing applications using Hadoop, Spark and NoSQL DB and Hadoop streaming.
• 5+ years of experience in building scalable enterprise data warehousing and modelling on prem and/or cloud (AWS, GCP, Azure)
-
Associate Principal – Data Engineering
3 weeks ago
Bangalore Metropolitan Area, India MathCo Full timeAs an Associate Principal – Data Engineering, you’ll have an opportunity to work on the universe of data and solve some very interesting problems by creating and maintaining scalable data pipelines dealing with petabytes of data. All our projects entail working on cutting edge technologies, petabyte scale data processing systems, data warehouses and data...
-
Principal Data Engineer
5 days ago
bangalore, India 14260 GSK India Global Services Private Limited Full timeAt GSK, we are dedicated to improving the quality of human life by enabling people to do more, feel better, and live longer. As a global leader in pharmaceuticals and healthcare, we have a rich history dating back to the 19th century and a relentless commitment to advancing healthcare for the betterment of humanity. Our mission is to help people around...
-
Principal Data Engineer
5 days ago
bangalore, India VISA Full timeJob Description And Responsibilities Are you interested in building world class B2B data solutions & products serving 6 markets, 50+ countries fueling growth? With tremendous amount of data there is a huge untapped potential to uncover insights, architect state of the art data platforms & cutting-edge application development. Commercial and Money...
-
Principal Data Engineer
5 days ago
Bangalore, India Visa Full timeJob DescriptionAre you interested in building world class B2B data solutions & products serving 6 markets, 50+ countries fueling growth? With tremendous amount of data there is a huge untapped potential to uncover insights, architect state of the art data platforms & cutting-edge application development. Commercial and Money Movement Solutions (CMS), one of...
-
Associate Principal
2 months ago
bangalore, India LTIMindtree Full timeAssociate Principal - Software Engineering Job Req Id: 1274490 Location: BangaloreExp: 12 Yrs - 16 YrsSPOC: Chakravarthy.BRKey Skills: Marketo, HTML,CSSJob Description: "Mandatory Skills:This exciting and interesting position will have the below responsibilities:? Playing a key liaison role during technology implementation, providing direction and...
-
Principal Data Engineer
6 days ago
bangalore, India NeoStats Full timeAbout Us:NeoStats is new age, Data & Analytics firm offering contemporary solutions and infinite possibilities. Our mission is to create lasting competitive advantage for our clients by transforming them to world- class, data driven organizations. Established in 2022 to provide End to End Data & Analytics Services, we are headquartered out of UAE, with bases...
-
Principal Data Engineer
6 days ago
bangalore, India NeoStats Full timeAbout Us: NeoStats is new age, Data & Analytics firm offering contemporary solutions and infinite possibilities. Our mission is to create lasting competitive advantage for our clients by transforming them to world- class, data driven organizations. Established in 2022 to provide End to End Data & Analytics Services, we are headquartered out of UAE, with...
-
Software Senior Principal Engineer
1 day ago
bangalore, India Dell International Services India Pvt Ltd (7451) Full timeSoftware Senior Principal Engineer The Software Engineering team delivers next-generation application enhancements and new products for a changing world. Working at the cutting edge, we design and develop software for platforms, peripherals, applications and diagnostics — all with the most advanced technologies, tools, software engineering...
-
Principal Data Engineer
4 weeks ago
bangalore, India Procore Technologies Full timeJob DescriptionWe’re looking for a Principal Data Engineer to join Procore’s Data Division. In this role, you’ll help build Procore’s next-generation construction data platform for others to build upon including Procore developers, analysts, partners, and customers. As a Principal Data Engineer , you’ll use your expert-level technical skills to...
-
Principal Engineer – Data
5 days ago
bangalore, India 14260 GSK India Global Services Private Limited Full timeUniting science, technology, and talent to get ahead of disease together GSK is a global biopharma company with a special purpose – to unite science, technology, and talent to get ahead of disease together – so we can positively impact the health of billions of people and deliver stronger, more sustainable shareholder returns – as an organization...
-
Principal Engineer
4 weeks ago
bangalore, India Amazon Development Center India Private Limited - Kerala - P86 Full timePrincipal Engineers provide technical leadership at Amazon.com. They help establish technical standards and drive Amazon’s overall technical architecture, engineering practices, and engineering methodologies. They work on our hardest problems, building high quality, architecturally sound systems that are aligned with our business needs. They think globally...
-
Principal Data Scientist
2 months ago
bangalore, India Oracle Full timeAbout Oracle CrowdTwist Oracle CrowdTwist provides the most comprehensive omni-channel loyalty & analytics SaaS platform for industry leading brands. We have grown to a respected platform with hundreds of millions of users and billions of interactions. We are looking to write the next chapter in user growth and scale. We power the loyalty offerings for...
-
Associate Principal
2 months ago
bangalore, India LTIMindtree Full timeAssociate Principal - Quality Engineering Job Req Id: 1272971 Candidate with experience in Digital & Mobility platforms like CMS(AEM), Digital packages(Hybris, Demand ware, ATG , Candidate need to have experience in deriving the test strategy for Service / Layer level testing for ex: Web services, micro-services and experience in Automation –...
-
Principal software engineer IT
2 weeks ago
bangalore, India Quess Full timeAbout Us “Quess IT Staffing is India’s largest IT staffing company with over 20 years of experience in staffing IT professionals in 300+ companies across levels and skillsets. Our 10,000+ associates deployed in 80+ cities and towns are proficient in over 500 technological skills. Our associates help enable cutting edge solutions some of the biggest names...
-
Principal Data Scientist
2 weeks ago
bangalore, India MakeMyTrip Full timeWe are looking for a Principal/Senior Principal Data Scientist to join our dynamic team at MakeMyTrip. This is an exceptional opportunity for a seasoned expert to contribute to our hotel ranking recommendation systems. Job Description: As a Principal Data Scientist, you will: Build, deploy, and monitor cutting-edge DL and ML ranking search models, learning...
-
Principal Consultant- Data Engineer
1 month ago
bangalore, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...
-
Associate ,Data Engineering
2 weeks ago
bangalore, India ResMed Full timeDescription : Digital Health Technology team powers digital experiences and engagement to enhance the lives of millions of people every day through connected care. We build, deliver, and manage a portfolio of data management platforms and mobile offerings in support of our core businesses. We thrive on simple and elegant architecture and agility....
-
Principal Data Engineer
24 hours ago
bangalore, India Red Hat India Private Limited Full timeJob Summary The Data Development, Insights & Strategy team is a highly focused effort to lead digital-first execution and transformation at Red Hat leveraging data strategically for our customers, partners, and associates. As a Data Engineer, you will play a critical role in building and managing data solutions to support our organization's data-driven...
-
bangalore, India Capital One Full timeVoyager (94001), India, Bangalore, KarnatakaPrincipal Associate, Machine Learning Engineer At Capital One India, we work in a fast paced and intellectually rigorous environment to solve fundamental business problems at scale. Using advanced analytics, data science and machine learning, we derive valuable insights about product and process design, consumer...
-
Principal Associate, Software Engineering
5 days ago
bangalore, India Capital One Full timeVoyager (94001), India, Bangalore, KarnatakaPrincipal Associate, Software Engineering At Capital One, we think big and do bigger things. We were the first company to develop and offer mass customization and personalization of credit card, auto loans and other financial services products, and we have been innovating relentlessly ever since.Today, we are a...