Urgent Search) Lead Data Engineer

3 weeks ago

Bengaluru, Karnataka, India MathCo Full time
As a Lead Data Engineer, you will be responsible for:

- Leading a team of talented data engineers responsible for designing, building, and maintaining scalable data pipelines and infrastructure
- Work closely with cross-functional teams to ensure client data systems meet the highest standards of quality and performance
- Lead, mentor, and develop a team of data engineers, fostering a collaborative and inclusive team environment
- Conduct regular performance reviews, provide feedback, and set goals for team members
- Identify and address skill gaps, and provide opportunities for professional development
- Plan, execute, and deliver data engineering projects on time and within scope
- Coordinate with stakeholders to gather requirements, set priorities, and define project timelines.
- Ensure projects align with overall business objectives and data strategy
- Oversee the design, development, and maintenance of data pipelines, ETL processes, and data warehouse
- Ensure data quality, integrity, and security across all data engineering projects.
- Identify opportunities for process improvements and drive initiatives to enhance the efficiency and effectiveness of data operations.
- Has strong conceptual understanding of Data Warehousing and ETL, Data Governance and Security, Cloud Computing, and Batch & Real Time data processing
- Ability to build/drive reusable frameworks that can drive efficiency of the overall data system
- Has executed and lead multiple projects including on - streaming, batch, large data pipelines, etc.
- Manages conversation with the client stakeholders to understand the requirement and translate it into technical outcomes.

Required Tech Stack:

- Has strong execution knowledge of Data Modeling, Databases in general (SQL and NoSQL), software development lifecycle and practices, unit testing, functional programming, etc.
- Working knowledge of an ETL and/or orchestration tools like IICS, Metallion, Airflow, Azure Data Factory, AWS Glue, GCP Composer, etc.
- Working knowledge of one or more Data Warehouse like Snowflake, Redshift, Hive, Big Query, etc.
- Proficient in Spark and can optimize Spark jobs with ease.
- Proficient in at least one programming language used in data engineering, such as Python (Non-negotiable) and Scala/Rust/Java
- Understanding of Medallion architecture pattern
- Has strong SQL knowledge along with optimization skills

Required Non-Tech Stack

- Strong problem-solving skills with an ability to assess the financial impact of decisions, both in running the delivery team and delivering solutions to clients.
- Proficient in written and verbal communication and able to hold conversations with mid-management-level clients.
- Ability to recognize pragmatic alternatives vis-à-vis a perfect solution and get the delivery teams on board to pursue them, balancing time priorities with potential business impact.
- Strong people skills, including conflict resolution, empathy, communication, listening, and negotiation.
- Shows proficiency in providing technical guidance and provide leadership and mentorship to the delivery team.
- Self-driven with a strong sense of ownership.

Preferred Educational Qualifications

- B.E/B.Tech, MCA, M.Sc. (Mathematics, Statistics)

  • Urgent Search) Database Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 304492NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Database Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN NTT DATA Services currently seeks...

  • Urgent Search) Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Takeda Full time

    By clicking the Apply button I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda s and I further attest that all information I submit in my employment application is true to the best of my knowledge The Future Begins Here At Takeda ...

  • Urgent Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - ETL to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties:. Migrate ETL workflows from...

  • Databricks Lead Urgent

    4 days ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Databricks Lead to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Wyndham Group of Hotels is...

  • Urgent Search

    3 weeks ago

    Bengaluru, Karnataka, India Swivl Full time

    Location Hybrid Bengaluru Company Swivl TechSwivl Tech is a rapidly growing company that provides field service businesses with tools to improve their operations and profitability As a new domain we are looking to hire an experienced SEO Expert to help us establish a strong online presence and improve our search engine rankings The right candidate will...

  • Urgent Search Senior Tester

    2 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Tester to join our team in Bengaluru, Karntaka (IN-KA), India (IN).Senior TesterWho we are:NTT DATA America's...

  • Urgent Search) Data Engineer 1

    3 weeks ago

    Bengaluru, Karnataka, India Jones Lang LaSalle Full time

    JLL empowers you to shape a brighter way Our people at JLL and JLL Technologies are shaping the future of real estate for a better world by combining world class services advisory and technology for our clients We are committed to hiring the best most talented people and empowering them to thrive grow meaningful careers and to find a place where they...

  • Urgent Search AWS Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Synechron Full time

    We have immediate opportunity for AWS Data Engineer.Job Role: AWS Data EngineerJob Location: BangaloreExperience- 7-12YearsAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's...

  • Urgent Search Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India ACL Digital Full time

    Key Responsibilities:- Design, develop, and maintain ETL workflows using AWS Glue, Lambda, and DMS- Process and transform large datasets using Apache Spark (PySpark)- Work with Amazon RDS and other relational databases to ingest and export data- Write efficient and optimized SQL queries for data transformation and analysis- Collaborate with data scientists,...

  • Urgent Search Lead

    4 weeks ago

    Bengaluru, Karnataka, India Halliburton Full time

    Job DescriptionJob descriptionStrong understanding of Hire to Retire (H2R) processes, including HR processes, Employee Master Data, Payroll Processing, Payroll Accounting, and Key Business Metrics Reporting.- Knowledge of SAP, SuccessFactors, ADP GlobalView, ADP Celergo, Salesforce, and other leading ERPs. Familiarity with reporting tools like Blackline,...