Data Engineer

4 weeks ago

Delhi, India Sigmaways Inc Full time
As a Sr. Data Engineer, you will be a key member of our team, responsible for designing, developing, and maintaining sophisticated software / data platforms in achieving the charter of the engineering group. Your mastery of a technical domain enables you to take up business problems and solve them with a technical solution. With your depth of expertise and leadership abilities, you will actively contribute to architectural decisions, mentor junior engineers, and collaborate closely with cross-functional teams to deliver high-quality, scalable software solutions that advance our impact in the market. This is a role where you will have the opportunity to take up responsibility in leading the technology effort – from technical requirements gathering to final successful delivery of the product - for large initiatives (cross-functional and multi-month-long projects).

RESPONSABILITIES

Lead the design and implementation of scalable, efficient, and robust data architectures to meet business needs and analytical requirements.Collaborate with stakeholders to understand data requirements, build subject matter expertise, and define optimal data models and structures.Data Pipeline Development and Optimization:Design and develop data pipelines, ETL processes, and data integration solutions for ingesting, processing, and transforming large volumes of structured and unstructured data.Optimize data pipelines for performance, reliability, and scalability.Database Management and Optimization:Oversee the management and maintenance of databases, data warehouses, and data lakes to ensure high performance, data integrity, and security.Implement and manage ETL processes for efficient data loading and retrieval.Establish and enforce data quality standards, validation rules, and data governance practices to ensure data accuracy, consistency, and compliance with regulations.Drive initiatives to improve data quality and documentation of data assets.Provide technical leadership and mentorship to junior team members, assisting in their skill development and growth.Lead and participate in code reviews, ensuring best practices and high-quality code.Collaboration and Stakeholder Management:Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand their data needs and deliver solutions that meet those needs.Communicate effectively with non-technical stakeholders to translate technical concepts into actionable insights and business value.Performance Monitoring and Optimization:Implement monitoring systems and practices to track data pipeline performance, identify bottlenecks, and optimize for improved efficiency and scalability.Common Software Engineering RequirementsYou actively contribute to the end-to-end delivery of complex software applications, ensuring adherence to best practices and high overall quality standards.You have a strong understanding of a business or system domain with sufficient knowledge & expertise around the appropriate metrics and trends. You collaborate closely with product managers, designers, and fellow engineers to understand business needs and translate them into effective software solutions.You provide technical leadership and expertise, guiding the team in making sound architectural decisions and solving challenging technical problems. Your solutions anticipate scale, reliability, monitoring, integration, and extensibility.You conduct code reviews and provide constructive feedback to ensure code quality, performance, and maintainability. You mentor and coach junior engineers, fostering a culture of continuous learning, growth, and technical excellence within the team.You play a significant role in the ongoing evolution and refinement of current tools and applications used by the team, and drive adoption of new practices within your team.You take ownership of (customer) issues, including initial troubleshooting, identification of root cause and issue escalation or resolution, while maintaining the overall reliability and performance of our systems.You set the benchmark for responsiveness and ownership and overall accountability of engineering systems.You independently drive and lead multiple features, contribute to (a) large project(s) and lead smaller projects. You can orchestrate work that spans multiples engineers within your team and keep all relevant stakeholders informed. You support your lead/EM about your work and that of the team, that they need to share with the stakeholders, including escalation of issues

QUALIFICATIONS

Bachelor's or Master's degree in Computer Science, Data Science, or a related field.10+ years of experience in data engineering, with a focus on data architecture, ETL, and database management.Proficiency in programming languages like Python/PySpark and Java or /ScalaExpertise in big data technologies such as Hadoop, Spark, Kafka, etc.In-depth knowledge of SQL and experience with various database technologies (e.g., PostgreSQL, MariaDB MySQL, NoSQL databases).Experience and expertise in building complex end-to-end data pipelines.Experience with orchestration and designing job schedules using the CICD tools like Jenkins, Airflow or DatabricksAbility to lead ETL migration from Talend to Databricks pysparkDemonstrated building capabilities, reusable utilities, and tools for speeding complex business processes.Ability to work in an Agile environment (Scrum, Lean, Kanban, etc)Ability to mentor junior team members.Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services (e.g., AWS Redshift, S3, Azure SQL Data Warehouse).Strong leadership, problem-solving, and decision-making skills.Excellent communication and collaboration abilities.Familiarity or certification in Databricks is a plus.

  • Data Platform Engineer

    4 weeks ago

    Delhi, Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we're redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we've built a...

  • Data Platform Engineer

    4 weeks ago

    New Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Data Platform Engineer

    4 weeks ago

    New Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Lead Data Engineer

    3 weeks ago

    Delhi, Delhi, India Pacific Data Integrators Full time

    Job Title:Lead Data Engineer (IDMC-CDI)Location:RemoteMode of Work: Work from OfficeWorking Hours: US Shift (5 PM to 2 AM IST)Primary Skills: SQL, IDMC (CDI), ETL ConceptsExperience: 8+ YearsAbout the JobAre you someone with a deep understanding of ETL and a strong background in developing IDMC ETL-based solutions, capable of developing, documenting, unit...

  • Backend Engineer

    3 days ago

    Delhi, Delhi, India Central Data Storage Full time

    We are looking for a skilled Software Engineer to join our team in Hyderabad, India. The successful candidate will be responsible for back-end web development, software development, and programming tasks to support data protection and business continuity solutions.Key Responsibilities:Collaborate with architects and senior developers to design and implement...

  • Data Scientist

    4 weeks ago

    Delhi, India Applied Data Finance Full time

    Job Description: Data Scientistwith good Business analytics Experience (Preferably in financial domain, but not mandatory)Position Title:Data Scientist/Senior Data ScientistLocation:Remote (Hybrid option available, if in Chennai)Department:Analytics, Risk and R&DPosition Type:Full-TimeJob Summary:We are seeking skilled and motivated Data Scientists with 2-5...

  • Data Protection Specialist

    4 days ago

    Delhi, Delhi, India Central Data Storage Full time

    About UsCentral Data Storage is a Series A-funded startup at the forefront of data backup and cybersecurity. We empower mid-market and enterprise businesses with comprehensive data protection and business continuity solutions.Job OpportunityWe are looking for a talented Software Engineer to join our team in Hyderabad, India. As a Software Engineer, you will...

  • Data Discovery Analyst

    3 days ago

    Delhi, Delhi, India Big Data Trunk Full time

    Experience:- not more than 1 year or Data Discovery Analyst Internship Qualifications & Requirements Education: B.Sc. in Computer Science, BCA, or Equivalent Degree (Final-year students can apply for internships), B.A. B.Com, Any Graduate Technical Skills (Good to Have) Basic knowledge of any programming languageSoft Skills Good communication skills for...

  • Tatras Data

    2 weeks ago

    Delhi, Delhi, India Tatras Data Services Pvt Ltd Full time

    Job Title : Data Engineer - Data Fabric/BricksLocation : RemoteJob Summary :We are seeking an experienced Data Engineer to join our team as contractor. The ideal candidate will have a strong background in designing, implementing, and managing large-scale data platforms using Data Fabric or Data Bricks. The candidate should have experience working with both...

  • Cloud Engineer

    3 weeks ago

    Delhi, Delhi, India NTT DATA Full time

    Hi,Urgent looking AWS Cloud BI Data Engineer (#Redshift, #Airflow, Python, Linux/Unix, Stored Procedure, DataWarehouse, ETL ) in Pan India.Please Email your CV, Current CTC, Expected CTC, Notice Time at

  • Software Engineer

    3 days ago

    Delhi, Delhi, India Central Data Storage Full time

    Company DescriptionCentral Data Storage is a Series A-funded startup at the forefront of data backup and cybersecurity. We empower mid-market and enterprise businesses with comprehensive data protection and business continuity solutions. Role Description This is a full-time on-site Software Engineer role located in Hyderabad, India at Central Data Storage....

  • Senior Software Engineer/Technical Lead

    3 weeks ago

    Delhi, Delhi, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Senior Software Engineer/Technical Lead

    3 weeks ago

    Delhi, Delhi, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Software engineer

    4 days ago

    Delhi, Delhi, India Central Data Storage Full time

    Company DescriptionCentral Data Storage is a Series A-funded startup at the forefront of data backup and cybersecurity. We empower mid-market and enterprise businesses with comprehensive data protection and business continuity solutions.Role DescriptionThis is a full-time on-site Software Engineer role located in Hyderabad, India at Central Data Storage. The...

  • Data Insights Specialist

    3 days ago

    Delhi, Delhi, India Big Data Trunk Full time

    Company Overview">At Big Data Trunk, we are dedicated to harnessing the power of data to drive business success. Our team is passionate about working with clients to uncover insights and make informed decisions.">Job Description">We are seeking a highly motivated Data Discovery Analyst to join our team. As a key member of our business intelligence team, you...

  • Software Engineer

    2 weeks ago

    Delhi, Delhi, India Central Data Storage Full time

    Company DescriptionCentral Data Storage is a Series A-funded startup at the forefront of data backup and cybersecurity. We empower mid-market and enterprise businesses with comprehensive data protection and business continuity solutions.Role DescriptionThis is a full-time on-site Software Engineer role located in Hyderabad, India at Central Data Storage. The...

  • Software Engineer

    3 weeks ago

    Delhi, Delhi, India Central Data Storage Full time

    Company DescriptionCentral Data Storage is a Series A-funded startup at the forefront of data backup and cybersecurity. We empower mid-market and enterprise businesses with comprehensive data protection and business continuity solutions.Role DescriptionThis is a full-time on-site Software Engineer role located in Hyderabad, India at Central Data Storage. The...

  • [15h Left] Data Scientist

    4 weeks ago

    Delhi, India Applied Data Finance Full time

    Job Description: Data Scientist with good Business analytics Experience (Preferably in financial domain, but not mandatory) - Position Title: Data Scientist/Senior Data Scientist - Location: Remote (Hybrid option available, if in Chennai) - Department: Analytics, Risk and R&D - Position Type: Full-Time - Job Summary: We are seeking skilled and motivated...

  • MS Engineer L2

    4 weeks ago

    Delhi, Delhi, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    4 weeks ago

    Delhi, Delhi, India Zemoso Technologies Full time

    Job Title: Data EngineerExperience: 3+ Years data pipelines experienceLocation: Chennai/MumbaiWork type: HybridJob Type: Full-timeKey Responsibilities:● Python Proficiency:Demonstrate a strong command of Python programming language, actively contributing to thedevelopment and maintenance of data engineering solutions.● Data Engineering Expertise:Set up...