Data Engineer-Technical Lead

10 hours ago

New Delhi, India Sigmoid Full time

Kindly find the Job Description Below.Job Title:Technical Lead-Azure Data EngineerLocation: BangaloreYears of Experience: 10+ years of experienceSigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software Development Engineer.As an Technical Lead- Data Engineer, you will be responsible for building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.We are looking for a skilled Data Engineer with 10+ years of experience in big data technologies, particularly Azure, Python, PYSpark, SQL and data lakehouse architectures. The ideal candidate will have a strong background in building scalable data pipelines and experience with modern data storage formats, including Apache Iceberg. You will work closely with cross-functional teams to design and implement efficient data solutions in a cloud-based environment.Key Responsibilities:- Data Pipeline Development: - Design, build, and optimize scalable data pipelines using Apache Spark. - Implement and manage large-scale data processing solutions across data lakehouses. - Data Lakehouse Management: - Work with modern data lakehouse platforms (e.g.Apache Iceberg) to handle large datasets. - Optimize data storage, partitioning, and versioning to ensure efficient access and querying. - SQL & Data Management: - Write complex SQL queries to extract, manipulate, and transform data. - Develop performance-optimized queries for analytical and reporting purposes. - Data Integration: - Integrate various structured and unstructured data sources into the lakehouse environment. - Work with stakeholders to define data needs and ensure data is available for downstream consumption. - Data Governance and Quality: - Implement data quality checks and ensure the reliability and accuracy of data. - Contribute to metadata management and data cataloging efforts. - Performance Tuning: - Monitor and optimize the performance of Spark jobs, SQL queries, and overall data infrastructure. - Work with cloud infrastructure teams to optimize costs and scale as needed.Qualifications:- Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. - 9+ years of experience in data engineering, with a focus on Java/python, Spark and SQL Programming languages. - Hands-on experience with Apache Iceberg, Snowflake, or similar technologies. - Strong understanding of data lakehouse architectures and data warehousing principles. - Proficiency in AWS data services. - Experience with version control systems like Git and CI/CD pipelines. - Excellent problem-solving and analytical skills. - Strong communication and collaboration skills.Nice to Have:- Experience with containerization (Docker, Kubernetes) and orchestration tools like Airflow. - Certifications in Azure cloud technologies

  • Senior Software Engineer

    6 days ago

    New Delhi, India Crest Data Full time

    We are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments.Location: PUNE / AHMEDABAD ( WFO Only)Key Responsibilities- Responsible for providing expertise in software...

  • Senior Software Engineer/Technical Lead

    4 days ago

    New Delhi, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Senior Software Engineer

    4 days ago

    New Delhi, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products fromCisco, VMware, NetApp, Amazon AWS, EMC,...

  • Engineering Technical Lead

    2 weeks ago

    New Delhi, India Yotta Data Services Private Limited Full time

    Engineering Team Lead Role Overview We are looking for a dynamic senior software engineer to join us as Team Lead, Software Engineering and lead Engineering team units and create a culture of Engineering Excellence in and outside the organisation. This role is central to our organisations success as both a market force and a thought leader for driving...

  • Technical Lead-Data Engineer

    6 days ago

    New Delhi, India Best Infosystems Ltd. Full time

    Technical Lead-Data Engineer_Full-Time_Bangalore/Pune/Navi Mumbai/Noida/Hyderabad/ChennaiJob Title:Technical Lead-Data Engineer Location:Bangalore/Pune/Navi Mumbai/Noida/Hyderabad/Chennai Job Type:Full-Time Experience:8+ years Qualifications:Bachelor’s/relevant exp - with Snowpro CertificationJob Description: Must Have Skills: •Overall – 8+ years...

  • Technical Specialist

    2 weeks ago

    New Delhi, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...

  • Sr Operations Data Lead

    11 hours ago

    New Delhi, India Data Unveil Full time

    Position Title: Sr Operations Data LeadExperience: 4 Years to 6 YearsLocation: Hyderabad, TelanganaHire Type: Full Time, On-siteStart Date: ImmediateOverview:The Operations Data Delivery Lead is responsible for managing and overseeing the efficient delivery of data within the organization. This role ensures that data operations and delivery processes are...

  • Data Engineer

    2 weeks ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI SolutionsReports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Senior/Lead Data Engineer

    2 weeks ago

    Delhi, India Eucloid Data Solutions Full time

    About The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to designing...

  • Lead Data Engineer

    4 days ago

    New Delhi, India ATOM Systems Private Limited Full time

    Job DescriptionName of the position : Data EngineerLocation :Coimbatore / RemoteNo. of resources needed: 01Mode: Contract to HireYears of experience: 15+ YearsAbout the RoleWe are seeking a highly skilled and driven Data Engineering Lead to lead our data engineering team. The ideal candidate combines strong leadership and technical expertise with the ability...