Senior Data Engineer

2 weeks ago

Kanpur, Uttar Pradesh, India Sigmaways Inc Full time

As a Sr. Data Engineer you will be a key member of our team, responsible for designing, developing, and maintaining sophisticated software / data platforms in achieving the charter of the engineering group.

RESPONSABILITIES:

  • Lead the design and implementation of scalable, efficient, and robust data architectures to meet business needs and analytical requirements.
  • Collaborate with stakeholders to understand data requirements, build subject matter expertise, and define optimal data models and structures.
  • Data Pipeline Development and Optimization:
  • Design and develop data pipelines, ETL processes, and data integration solutions for ingesting, processing, and transforming large volumes of structured and unstructured data.
  • Optimize data pipelines for performance, reliability, and scalability.
  • Database Management and Optimization:
  • Oversee the management and maintenance of databases, data warehouses, and data lakes to ensure high performance, data integrity, and security.
  • Implement and manage ETL processes for efficient data loading and retrieval.
  • Establish and enforce data quality standards, validation rules, and data governance practices to ensure data accuracy, consistency, and compliance with regulations.
  • Drive initiatives to improve data quality and documentation of data assets.
  • Provide technical leadership and mentorship to junior team members, assisting in their skill development and growth.
  • Lead and participate in code reviews, ensuring best practices and high-quality code.
  • Collaboration and Stakeholder Management:
  • Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand their data needs and deliver solutions that meet those needs.
  • Communicate effectively with non-technical stakeholders to translate technical concepts into actionable insights and business value.
  • Performance Monitoring and Optimization:
  • Implement monitoring systems and practices to track data pipeline performance, identify bottlenecks, and optimize for improved efficiency and scalability.
  • Common Software Engineering Requirements
  • You actively contribute to the end-to-end delivery of complex software applications, ensuring adherence to best practices and high overall quality standards.
  • You have a strong understanding of a business or system domain with sufficient knowledge & expertise around the appropriate metrics and trends. You collaborate closely with product managers, designers, and fellow engineers to understand business needs and translate them into effective software solutions.
  • You provide technical leadership and expertise, guiding the team in making sound architectural decisions and solving challenging technical problems. Your solutions anticipate scale, reliability, monitoring, integration, and extensibility.
  • You conduct code reviews and provide constructive feedback to ensure code quality, performance, and maintainability. You mentor and coach junior engineers, fostering a culture of continuous learning, growth, and technical excellence within the team.
  • You play a significant role in the ongoing evolution and refinement of current tools and applications used by the team, and drive adoption of new practices within your team.
  • You take ownership of (customer) issues, including initial troubleshooting, identification of root cause and issue escalation or resolution, while maintaining the overall reliability and performance of our systems.
  • You set the benchmark for responsiveness and ownership and overall accountability of engineering systems.
  • You independently drive and lead multiple features, contribute to (a) large project(s) and lead smaller projects. You can orchestrate work that spans multiples engineers within your team and keep all relevant stakeholders informed. You support your lead/EM about your work and that of the team, that they need to share with the stakeholders, including escalation of issues.

QUALIFICATIONS:

  • Bachelor's or master's degree in computer science, Data Science, or a related field.
  • 10+ years of experience in data engineering, with a focus on data architecture, ETL, and database management.
  • Proficiency in programming languages like Python/Pyspark and Java or /Scala.
  • Expertise in big data technologies such as Hadoop, Spark, Kafka, etc.
  • In-depth knowledge of SQL and experience with various database technologies (e.g., PostgreSQL, MariaDB MySQL, NoSQL databases).
  • Experience and expertise in building complex end-to-end data pipelines.
  • Experience with orchestration and designing job schedules using the CICD tools like Jenkins, Airflow or Databricks.
  • Ability to lead ETL migration from Talend to Databricks pyspark.
  • Demonstrated building capabilities, reusable utilities, and tools for speeding complex business processes.
  • Ability to work in an Agile environment (Scrum, Lean, Kanban, etc.) .
  • Ability to mentor junior team members.
  • Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services (e.g., AWS Redshift, S3, Azure SQL Data Warehouse).
  • Strong leadership, problem-solving, and decision-making skills.
  • Excellent communication and collaboration abilities.
  • Familiarity or certification in Databricks is a plus.

  • Senior Manager-Data Center Operations

    2 weeks ago

    Kanpur, Uttar Pradesh, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT...

  • Senior Associate Specialist

    2 weeks ago

    Kanpur, Uttar Pradesh, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    7 days ago

    Kanpur, Uttar Pradesh, India FPL Technologies Full time

    Job Title: Data Engineer Location: Pune (Aundh) - Work From Office About FPL Technologies: Credit cards haven't changed much for over half a century so our team of seasoned bankers, technologists, and designers set out to redefine the credit card for you - the consumer. The result is OneCard - a credit card reimagined for the mobile generation. OneCard is...

  • Senior Engineer

    2 weeks ago

    Kanpur, Uttar Pradesh, India NTT Full time

    JOB DESCRIPTION Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive. Your day at...

  • Senior Engineer

    2 weeks ago

    Kanpur, Uttar Pradesh, India Technip Energies Full time

    About Us At Technip Energies, we believe in a better tomorrow, and we believe we can make tomorrow better. With approximately 15,000 talented women and men, we are a global and leading engineering and technology company, with a clear vision to accelerate the energy transition. Designing and delivering added value energy solutions is what we do.  If you...

  • Data Engineer

    1 week ago

    Kanpur, Uttar Pradesh, India Dean Infotech Full time

    Job Role - Data Engineer What you will need 5-7 years of experience in Solution, Design and Development of Cloud based datamodels, ETL Pipelines and infrastructure for reporting, analytics, and data science. Experience working with Spark, Hive, HDFS, MR, Apache Kafka/AWS Kinesis. Experience with version control tools (Git, Subversion)....

  • Azure Data Engineer

    1 week ago

    Kanpur, Uttar Pradesh, India Ampstek Full time

    Job Title: Azure Data EngineerLocation: 100% RemoteJob Type: ContractRequired Skills & Experience:• 8+ years of experience in data engineering, with a focus on schema design and data modeling.• Strong expertise in Azure Data Services (Azure Data Lake, Azure Synapse Analytics, Azure SQL Database, Cosmos DB, Databricks, Azure Data Factory).• Hands-on...

  • Senior Data Scientist

    2 weeks ago

    Kanpur, Uttar Pradesh, India Technip Energies Full time

    About Technip Energies At Technip Energies, we believe in a better tomorrow and we believe we can make tomorrow better. With approximately 15,000 talented women and men, we are a global and leading engineering and technology company, with a clear vision to accelerate the energy transition. Designing and delivering added value energy solutions is what we...

  • AWS Data Engineer

    2 weeks ago

    Kanpur, Uttar Pradesh, India Hirextra -World's First Staffing Aggregator Full time

    We are seeking a skilled AWS Data Engineer with expertise in various AWS services. The an ideal candidate will have hands-on experience with Lambda, Glue, SNS, SQS, Step Functions, PySpark, Python, Athena, CloudWatch, S3, and more. The successful candidate should also have working experience with various data file formats such as JSON, XML, CSV, Parquet....

  • Senior Manager-Data Center Operations

    7 days ago

    Kanpur, Uttar Pradesh, India NTT America Solutions, Inc. Full time

    **Make an impact with NTT DATA**Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it's a place where you can grow, belong and thrive.**Your day at NTT DATA**The Senior...

  • Senior Manager-Data Center Operations

    2 weeks ago

    Kanpur, Uttar Pradesh, India NTT Full time

    JOB DESCRIPTION Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive. Your day at...

  • Senior Manager-Data Center Operations Professional

    6 days ago

    Kanpur, Uttar Pradesh, India NTT America Solutions, Inc. Full time

    Job DescriptionNTT America Solutions, Inc. is seeking a Senior Manager-Data Center Operations to join our team.About the RoleThe Senior Manager, Critical Facilities Operations and Maintenance will be responsible for the operational integrity, commissioning and regulatory compliance of the electrical power, mechanical, monitoring and control systems, and the...

  • Senior DFT Engineer

    3 weeks ago

    Kanpur, Uttar Pradesh, India Texas Instruments Full time

    We are seeking talented and motivated individuals to join our team in developing cutting-edge solutions with Application-Specific Microcontrollers (MCUs) for the rapidly evolving automotive industry. Our MCUs power a wide range of critical vehicle functions, including traction control, onboard charging (OBC) and DC-DC converters, advanced lighting systems,...

  • Senior IT Support Engineer

    6 days ago

    Kanpur, Uttar Pradesh, India IT BY DESIGN Full time

    Job DescriptionThe Senior IT Support Engineer position at IT By Design involves providing advanced technical support to our clients. This includes troubleshooting and resolving complex IT issues, managing IT infrastructure, and collaborating with cross-functional teams to ensure smooth service delivery.In this role, you will leverage your technical expertise...

  • Senior Search Engine Optimization Specialist

    3 days ago

    Kanpur, Uttar Pradesh, India Republic World Full time

    Job OverviewRepublic World is seeking a highly skilled Senior Search Engine Optimization Specialist to join our dynamic team. The ideal candidate will have a proven track record of delivering growth through effective SEO strategies and techniques.The successful candidate will be responsible for developing and executing comprehensive SEO plans that drive...

  • Senior Electrical Systems Engineer

    5 days ago

    Kanpur, Uttar Pradesh, India GE Vernova Full time

    **Job Overview**We are seeking a highly skilled Senior LV Secondary Engineer to join our North Europe Grid System Integration (GSI) team. As a key member of the team, you will be responsible for leading LV references solution and supporting projects team on key subjects.Key Responsibilities:Developing department talent and engineering process...

  • Senior LV Secondary Engineer

    5 days ago

    Kanpur, Uttar Pradesh, India GE Vernova Full time

    **Job Description Summary**Become part of a winning team and help to deliver the Green Energy transition**Job Description**As a **Senior LV Secondary Engineer** , you will be working across two engineering disciplines. Solution and engineering centre (ITO and OTR in all aspects of HVDC LV secondary Engineering, reporting to the Head of Control & Protection...

  • Senior Associate Specialist

    6 days ago

    Kanpur, Uttar Pradesh, India NTT America Solutions, Inc. Full time

    About the RoleAs a Senior Associate Specialist at NTT DATA, you will play a key role in supporting the design and construction of complex data centers. This position involves collaborating with cross-functional teams to define mechanical systems design requirements for multiple projects from inception to completion.The ideal candidate will have moderate...

  • Director, Portfolio Marketing

    2 weeks ago

    Kanpur, Uttar Pradesh, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT...

  • Senior ETL Developer

    7 days ago

    Kanpur, Uttar Pradesh, India Strategic Talent Partner Full time

    As a QA Automation Engineer specialising in Data Warehousing, you will play a critical role in ensuring that our data solutions are of the highest quality. About the Role Develop and implement automation frameworks using tools like Python, Java, or similar, with a focus on database and ETL testing. Work closely with data engineers and analysts to understand...