Senior Data Engineer

1 month ago

Bengaluru, India Visa Full time
Job DescriptionThe Senior Data Engineer role involves leading and mentoring a team of data engineers, coordinating with other teams to manage and prioritize projects, and driving the strategy, roadmap, and execution of key data engineering initiatives. The role requires understanding and translating business needs into data models, creating robust data pipelines, and developing and maintaining data lakes. It also involves implementing and maintaining CI/CD pipelines for data solutions. The candidate should be able to define and manage data load procedures, implement data strategies, and ensure robust operational data management systems. Collaborating with stakeholders across the organization to understand their data needs and deliver solutions is also a key part of this role. The ideal candidate will be proficient in big data tools like Hadoop, Hive, and Spark, programming languages such as Scala, Python, SQL, and have strong analytical skills related to working with structured and unstructured datasets.

Essential Functions:Experience in Requirement Gathering, Estimating, Managing large scale Data Engineering Projects.Requirement Analysis: Understand and translate business needs into data models supporting long-term solutions.Data Modeling: Work with the Business team to implement data strategies, build data flows and develop conceptual data models.Data Pipeline Design: Create robust and scalable data pipelines and data products in a variety of domains.Data Integration: Develop and maintain data lakes by acquiring data from primary and secondary sources and build scripts that will make our data evaluation process more flexible or scalable across data sets.Testing: Define and manage the data load procedures to reject or discard datasets or data points that do not meet the defined business rules and quality thresholds.Deployment: Implement data strategies and develop physical data models, along with the development teams, data analyst teams and information system team to ensure robust operational data management systems.Understanding of and ability to Implement Data Engineering principles and best practices.Team Leadership: Lead and mentor a team of data engineers. Coordinate with other teams to manage and prioritize projects. Drive strategy, roadmap, and execution of key data engineering initiatives.Stakeholder Management: Collaborate with stakeholders across the organization to understand their data needs and deliver solutions.Continuous Integration and Continuous Deployment (CI/CD): Implement and maintain CI/CD pipelines for data solutions, ensuring rapid, reliable, and streamlined updates to the data environment.

QualificationsTechnical Skills:• Extensive experience in big data tools: Hadoop, Hive, and Spark.• Proficiency in Scala, Python, SQL, and PySpark.• Experience with Unix/Linux systems with scripting experience in Bash.• Experience with data pipeline and workflow management tools like Airflow, etc.• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.• Experience with cloud services AWS or Azure.• Experience with stream-processing systems: Kafka, Spark-Streaming, etc.• Strong analytic skills related to working with structured & unstructured datasets.• Proficiency in managing and communicating data warehouse plans to internal clients.• Experience with building processes supporting data transformation, data structures, metadata, dependency, and workload management.• A successful history of manipulating, processing, and extracting value from large, disconnected datasets.

Other Skills:• Strong problem-solving skills.• Excellent communication skills.• Ability to work in a team.• Detail-oriented and excellent organizational skills.

• 8+ years of work experience with a bachelor’s degree or at least 5+ years of work experience with an Advanced degree (e.g. Master’s, MBA, JD, MD) or 3+ years of work experience with a PhD degree• Exposure to Financial Services/ Payments Industry• Proven leadership skills with experience leading a team of data engineers.Leadership Competencies• Exhibits intellectual curiosity and a desire for continuous learning.• Demonstrates integrity, maturity, and a constructive approach to business challenges.• Role model for the organization and implementing core Visa Values• Respect for the Individuals at all levels in the workplace• Strive for Excellence and extraordinary results.• Use sound insights and judgments to make informed decisions in line with business strategy and needs.• Leadership skills include an ability to allocate tasks and resources across multiple lines of businesses and geographies. Leadership extends to ability to influence senior management within and outside Analytics groups.• Ability to successfully persuade/influence internal stakeholders for building best-in-class solutions.

  • Senior Engineer

    1 month ago

    Bengaluru, India Senior Engineer - Product Engineering (Thermal) Full time

    At Trane Technologies we Challenge the Possible. Our brands – including Trane® and Thermo King® - create access to cooling and comfort in buildings and homes, transport and protect food and perishables, connect customers to elevated performance with less environmental impact, dramatically reduce energy demands and carbon emissions, and innovate with a...

  • Senior Engineer

    1 month ago

    Bengaluru, India Senior Engineer - Product Engineering (Thermal) Full time

    At Trane Technologies we Challenge the Possible. Our brands – including Trane® and Thermo King® - create access to cooling and comfort in buildings and homes, transport and protect food and perishables, connect customers to elevated performance with less environmental impact, dramatically reduce energy demands and carbon emissions, and innovate with a...

  • Senior Engineer

    1 month ago

    Bengaluru, India Senior Engineer - Product Engineering (Thermal) Full time

    At Trane Technologies we Challenge the Possible. Our brands – including Trane® and Thermo King® - create access to cooling and comfort in buildings and homes, transport and protect food and perishables, connect customers to elevated performance with less environmental impact, dramatically reduce energy demands and carbon emissions, and innovate with a...

  • Senior Engineer

    1 month ago

    Bengaluru, India Senior Engineer - Product Engineering (Thermal) Full time

    At Trane Technologies we Challenge the Possible. Our brands – includingTrane®andThermo King®- create access to cooling and comfort in buildings and homes, transport and protect food and perishables, connect customers to elevated performance with less environmental impact, dramatically reduce energy demands and carbon emissions, and innovate with a better...

  • Sr data engineer

    2 months ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 286326 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Senior data...

  • Sr data engineer

    4 weeks ago

    Bengaluru, India NTT DATA Services Full time

    Req ID: 286326 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Senior data engineer  Strong...

  • Senior Data Engineer

    20 hours ago

    Bengaluru, India INFONET Full time

    Company DescriptionInfoNet provides customized software solutions for businesses of all sizes, from startups to Forbes 500 enterprises. Since 1996, we've been dedicated to helping companies streamline operations, enhance customer experiences, and drive growth with cutting-edge technology. Our team of developers, engineers, and consultants delivers tailored...

  • Data Engineer

    2 months ago

    Bengaluru, India NTT DATA Full time

    Job Description Data Engineer Grade 07ResponsibilitiesAssure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements using Azure data factory and Azure databricksDevelop and maintain innovative Azure Azure data factory and Azure databricksSolution design using Microsoft Azure...

  • Senior Data Engineer

    1 week ago

    Bengaluru, India NI Full time

    Senior Data Engineer – Data Engineering About the role   We are seeking a Senior Data Engineer to join our team and play an integral part in building and maintaining our data infrastructure. The ideal candidate will have experience in designing and implementing complex data models and pipeline solutions and have a good understanding of database...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India Procore Full time

    Job DescriptionWe’re looking for a Senior Data Engineer to join Procore’s Data Division. In this role, you’ll help build Procore’s next-generation construction data platform for others to build upon including Procore developers, analysts, partners, and customers.  As a Senior Data Engineer, you’ll partner with other engineers and product managers...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, India Procore Technologies Full time

    Job DescriptionWe’re looking for a Senior Data Engineer to join Procore’s Data Division. In this role, you’ll help build Procore’s next-generation construction data platform for others to build upon including Procore developers, analysts, partners, and customers.  As a Senior Data Engineer, you’ll partner with other engineers and product managers...

  • Data Engineer

    2 months ago

    Bengaluru, India NTT DATA Services Full time

    Data Engineer Responsibilities Assure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements using Azure data factory and Azure databricks Develop and maintain innovative Azure Azure data factory and Azure databricks Solution design using Microsoft Azure services...

  • Data Engineer

    2 months ago

    Bengaluru, India NTT DATA Services Full time

    Data Engineer Grade 07 Responsibilities Assure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements using Azure data factory and Azure databricks Develop and maintain innovative Azure Azure data factory and Azure databricks Solution design using Microsoft Azure...

  • Senior Engineer

    2 months ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 284013 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Once You Are...

  • Senior Lead Engineer

    2 months ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 286689 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Remote, Karnātaka (IN-KA), India (IN).Salesforce...

  • Senior Data Engineer

    3 months ago

    Bengaluru, India CaaStle Full time

    Job Description: Senior Software Engineer - Data Team CaaStle is adding a new Senior Software Engineer with experience building scalable, data solutions, identifying and addressing performance bottlenecks, collaborating with other team members, and implementing best practices for data engineering. Our engineering process is fully agile, and has a really...

  • Data Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Services Full time

    Req ID: 287747 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Mandatory Skills and...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Mandatory Skills and...

  • Senior Data Engineer

    3 months ago

    Bengaluru, India News Corp Full time

    Job Description : Business Title: Senior Data Engineer About the Role We are looking for a Senior Data Engineer with experience in excellent analytical abilities in GCP BigQuery, ETL/BI, Python, Composer/Airflow, SQL, GCP Services - with the ability to operate in an agile environment and keen to detail while understanding the larger data...

  • Senior Data Engineer

    3 months ago

    Bengaluru, India Expedia Group Full time

    Senior Data Engineer:Our team is looking for a high performing and influential individual contributor who leads by example while continuing to mentor junior engineers, interacts consistently with tech leadership in the local organization, and develops complex and vaguely defined projects.Are you an expert in big data technologies with hands-on development...