Associate Principal – Data Engineering

3 weeks ago


bangalore, India MathCo Full time

As an Associate Principal – Data Engineering, you’ll have an opportunity to work on the universe of data and solve some very interesting problems by creating and maintaining scalable data pipelines dealing with petabytes of data. All our projects entail working on cutting edge technologies, petabyte scale data processing systems, data warehouses and data lakes to help manage the ever-growing information needs of our customers.


The responsibilities are detailed as below:

• Experience in understanding and translating data, analytic requirements and functional needs into technical requirements while working with global customers

• Build and maintain data pipelines to support large scale data management in alignment with data strategy and data processing standards

• Strong experience in database, data warehouse & data lake design & architecture

• Able to train & mentor team members

• Experience in Database programming using multiple flavor of SQL

• Deploy scalable data pipelines for analytical needs

• Experience in Big Data ecosystem - on-prem (Hortonworks/MapR) or Cloud (Dataproc/EMR/HDInsight)

• Worked on query languages/tools such as Hadoop, Pig, SQL, Hive, Sqoop and SparkSQL.

• Experience in any orchestration tool such as Airflow/Oozie for scheduling pipelines

• Exposure to latest cloud ETL tools such as Glue/ADF/Dataflow

• Understand and execute IN memory distributed computing frameworks like Spark (and/or DataBricks) and its parameter tuning, writing optimized queries in Spark

• Hands-on experience in using Spark Streaming, Kafka and Hbase

• Experience in any orchestration tool such as Airflow/Oozie

• Experience working in an Agile/Scrum development process


REQUIRED QUALIFICATIONS

We are looking for individuals who are curious, excited about learning, and navigating through the uncertainties and complexities that are associated with growing a company. Some qualifications that we think would help you thrive in this role are:

•BE/BS/MTech/MS in computer science or equivalent work experience.

• 10+ years of experience in building data processing applications using Hadoop, Spark and NoSQL DB and Hadoop streaming.

• 5+ years of experience in building scalable enterprise data warehousing and modelling on prem and/or cloud (AWS, GCP, Azure)



  • Bangalore Metropolitan Area, India MathCo Full time

    As an Associate Principal – Data Engineering, you’ll have an opportunity to work on the universe of data and solve some very interesting problems by creating and maintaining scalable data pipelines dealing with petabytes of data. All our projects entail working on cutting edge technologies, petabyte scale data processing systems, data warehouses and data...


  • bangalore, India 14260 GSK India Global Services Private Limited Full time

    At GSK, we are dedicated to improving the quality of human life by enabling people to do more, feel better, and live longer. As a global leader in pharmaceuticals and healthcare, we have a rich history dating back to the 19th century and a relentless commitment to advancing healthcare for the betterment of humanity. Our mission is to help people around...


  • bangalore, India VISA Full time

    Job Description And Responsibilities Are you interested in building world class B2B data solutions & products serving 6 markets, 50+ countries fueling growth? With tremendous amount of data there is a huge untapped potential to uncover insights, architect state of the art data platforms & cutting-edge application development. Commercial and Money...


  • Bangalore, India Visa Full time

    Job DescriptionAre you interested in building world class B2B data solutions & products serving 6 markets, 50+ countries fueling growth? With tremendous amount of data there is a huge untapped potential to uncover insights, architect state of the art data platforms & cutting-edge application development. Commercial and Money Movement Solutions (CMS), one of...

  • Associate Principal

    2 months ago


    bangalore, India LTIMindtree Full time

    Associate Principal - Software Engineering Job Req Id: 1274490 Location: BangaloreExp: 12 Yrs - 16 YrsSPOC: Chakravarthy.BRKey Skills: Marketo, HTML,CSSJob Description: "Mandatory Skills:This exciting and interesting position will have the below responsibilities:? Playing a key liaison role during technology implementation, providing direction and...


  • bangalore, India NeoStats Full time

    About Us:NeoStats is new age, Data & Analytics firm offering contemporary solutions and infinite possibilities. Our mission is to create lasting competitive advantage for our clients by transforming them to world- class, data driven organizations. Established in 2022 to provide End to End Data & Analytics Services, we are headquartered out of UAE, with bases...


  • bangalore, India NeoStats Full time

    About Us: NeoStats is new age, Data & Analytics firm offering contemporary solutions and infinite possibilities. Our mission is to create lasting competitive advantage for our clients by transforming them to world- class, data driven organizations. Established in 2022 to provide End to End Data & Analytics Services, we are headquartered out of UAE, with...


  • bangalore, India Dell International Services India Pvt Ltd (7451) Full time

    Software Senior Principal Engineer The Software Engineering team delivers next-generation application enhancements and new products for a changing world. Working at the cutting edge, we design and develop software for platforms, peripherals, applications and diagnostics — all with the most advanced technologies, tools, software engineering...


  • bangalore, India Procore Technologies Full time

    Job DescriptionWe’re looking for a Principal Data Engineer to join Procore’s Data Division. In this role, you’ll help build Procore’s next-generation construction data platform for others to build upon including Procore developers, analysts, partners, and customers.  As a Principal Data Engineer , you’ll use your expert-level technical skills to...


  • bangalore, India 14260 GSK India Global Services Private Limited Full time

    Uniting science, technology, and talent to get ahead of disease together GSK is a global biopharma company with a special purpose – to unite science, technology, and talent to get ahead of disease together – so we can positively impact the health of billions of people and deliver stronger, more sustainable shareholder returns – as an organization...

  • Principal Engineer

    4 weeks ago


    bangalore, India Amazon Development Center India Private Limited - Kerala - P86 Full time

    Principal Engineers provide technical leadership at Amazon.com. They help establish technical standards and drive Amazon’s overall technical architecture, engineering practices, and engineering methodologies. They work on our hardest problems, building high quality, architecturally sound systems that are aligned with our business needs. They think globally...


  • bangalore, India Oracle Full time

    About Oracle CrowdTwist Oracle CrowdTwist provides the most comprehensive omni-channel loyalty & analytics SaaS platform for industry leading brands. We have grown to a respected platform with hundreds of millions of users and billions of interactions. We are looking to write the next chapter in user growth and scale. We power the loyalty offerings for...

  • Associate Principal

    2 months ago


    bangalore, India LTIMindtree Full time

    Associate Principal - Quality Engineering Job Req Id: 1272971 Candidate with experience in Digital & Mobility platforms like CMS(AEM), Digital packages(Hybris, Demand ware, ATG , Candidate need to have experience in deriving the test strategy for Service / Layer level testing for ex: Web services, micro-services and experience in Automation –...


  • bangalore, India Quess Full time

    About Us “Quess IT Staffing is India’s largest IT staffing company with over 20 years of experience in staffing IT professionals in 300+ companies across levels and skillsets. Our 10,000+ associates deployed in 80+ cities and towns are proficient in over 500 technological skills. Our associates help enable cutting edge solutions some of the biggest names...


  • bangalore, India MakeMyTrip Full time

    We are looking for a Principal/Senior Principal Data Scientist to join our dynamic team at MakeMyTrip. This is an exceptional opportunity for a seasoned expert to contribute to our hotel ranking recommendation systems. Job Description: As a Principal Data Scientist, you will: Build, deploy, and monitor cutting-edge DL and ML ranking search models, learning...


  • bangalore, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...


  • bangalore, India ResMed Full time

    Description : Digital Health Technology team powers digital experiences and engagement to enhance the lives of millions of people every day through connected care. We build, deliver, and manage a portfolio of data management platforms and mobile offerings in support of our core businesses. We thrive on simple and elegant architecture and agility....


  • bangalore, India Red Hat India Private Limited Full time

    Job Summary The Data Development, Insights & Strategy team is a highly focused effort to lead digital-first execution and transformation at Red Hat leveraging data strategically for our customers, partners, and associates. As a Data Engineer, you will play a critical role in building and managing data solutions to support our organization's data-driven...


  • bangalore, India Capital One Full time

    Voyager (94001), India, Bangalore, KarnatakaPrincipal Associate, Machine Learning Engineer At Capital One India, we work in a fast paced and intellectually rigorous environment to solve fundamental business problems at scale. Using advanced analytics, data science and machine learning, we derive valuable insights about product and process design, consumer...


  • bangalore, India Capital One Full time

    Voyager (94001), India, Bangalore, KarnatakaPrincipal Associate, Software Engineering At Capital One, we think big and do bigger things. We were the first company to develop and offer mass customization and personalization of credit card, auto loans and other financial services products, and we have been innovating relentlessly ever since.Today, we are a...