Senior Data Engineer

12 hours ago

Agra, India Cloudwick Full time

About the roleWe are seeking Senior Data Engineers to join our data engineering team, who are passionate about data & analytics. The ideal fit for the role will have a strong background in handling large volumes of data with Apache Spark to build , enhance bespoke systems to harness data .The key focus of the position is to build or maintain systems to capture and store data on behalf of the business. Key ResponsibilitiesDesign, develop, and maintain ETL processes and data pipelines using AWS Glue with Pyspark. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions. Optimize and tune data pipelines for performance and scalability. Ensure data quality and integrity through robust testing and validation processes. Implement data governance and security best practices. Monitor and troubleshoot data pipelines to ensure continuous data flow and address any issues promptly.Stay up-to-date with the latest trends and technologies in data engineering. Required QualificationB.E/B.Tech, preferably in Computer Science Engineering with relevant work experience.7+ years of experience in handling data and designing ETL pipelines with mandatory 4+ years experience in writing Spark. Experience with AWS services such as Glue, Athena, S3, and Redshift is a plus.Good to have exposure to data modeling, data analytics, and design in both batch processing and real-time streaming. Solid understanding of data mapping, data processing patterns, distributed computing, and building applications for real-time and batch analytics Strong programming skills in design and implementation using Python, PySpark, SQL Good exposure in database architecture with SQL. Experience with multiple file formats like Avro, Parquet, ORC, and JSON. Developing, constructing, testing, and maintaining architectures for data lakes, data pipelines, data warehouses, and large-scale data processing systems on Databricks.

  • Data Engineer

    4 weeks ago

    Agra, India Idyllic Services Full time

    Experience: 5- 10 YearsNotice Period: 0-30 DaysMandatory Skills: Code Optimization , Shell Scripting, Data Engineering & ScalaPreferred Skills: Big Data tools like Spark, Hadoop & HiveJob Description:The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and building out new API integrations to support...

  • Senior Data Analyst

    4 hours ago

    Agra, India American Express Full time

    At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new...

  • Data engineer

    7 days ago

    Agra, India Digitalzone Full time

    About the Role As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Responsibilities Develop and maintain scalable ETL/ELT pipelines using Python, Airflow, and dbt Build and optimize real-time streaming pipelines using Kafka, Rabbit MQ, Spark and event-driven...

  • Senior Data Architect

    3 weeks ago

    Agra, India Spectral Consultants Full time

    We’re Hiring | Data Architect / Senior Data Architect (Azure + Databricks) Locations: Chennai | Bangalore | Hyderabad Experience: 9–16 Years | Hybrid Work Model Role Overview As a Data Architect / Senior Data Architect, you’ll lead the design, development, and delivery of cutting-edge data platforms leveraging Azure, Databricks, and GenAI technologies....

  • Learning Support Specialist

    1 week ago

    Agra, India Emeritus Full time

    About Emeritus:Emeritus is committed to teaching the skills of the future by making high-quality education accessible and affordable to individuals, companies, and governments around the world. It does this by collaborating with more than 50 top-tier universities across the United States, Europe, Latin America, Southeast Asia, India and China.Emeritus’...

  • Data engineer

    4 weeks ago

    Agra, India Amarilla Full time

    Job TitleData Systems Engineer – Construction Operations (Mumbai-based)About the CompanyAmarilla operates in India, Argentina and USA, delivering Custom Homes and Iconic construction Projects with precision, transparency, and technology as core drivers of execution.Join our Mumbai Team.We are seeking a full-time team member in India to own and evolve our...

  • Ai Data Engineer

    3 weeks ago

    Agra, India Whatjobs IN C2 Full time

    Job Title: AI Data Engineer Exp- 4 to 8 years Location- PAN India Job Description Key Responsibilities: - Build and maintain data infrastructure: Design and construct scalable, reliable data pipelines, storage, and processing systems in the cloud. - Ensure data quality: Clean, transform, and enrich raw data to create "business truth" that AI models can use...

  • Vice President, Data Engineering

    2 days ago

    agra, India Three Across Full time

    Role:- Vice President – Data Engineering & ArchitectureWork Mode:- RemoteAbout the Role:We are seeking a hands-on and visionary leader to serve as Vice President – Data Engineering & Architecture. This role will drive digital transformation through data, defining how it is structured, centralized, and leveraged to power analytics, automation, and AI...

  • Senior AI/ML Software Engineer

    4 weeks ago

    Agra, India Cableteque Full time

    The Company Cableteque comprises an international team with extraordinary wire interconnects, CAD deployments, and AI/ML expertise. Our team is located worldwide, including the US, Europe, and Asia. This enables us to assemble diverse perspectives, comprehensive knowledge, and specialized expertise to deliver the best software products and services to our...

  • Engineer I

    3 weeks ago

    Agra, India lululemon Full time

    About lululemon:lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,...