Sprouts.ai - Senior Data Architect - ETL/PySpark

3 weeks ago

Chandigarh, India Sprouts.ai Full time

Job Title : Senior Data ArchitectLocation : Bangalore/ChandigarhJob Type : Full-timeExperience : 10+ yearsJob Summary are looking for an experienced Data Architect to lead the design, development, and optimization of our modern data infrastructure. The ideal candidate will have deep expertise in big data platforms, data lakes, lakehouse architectures, and hands-on experience with modern tools such as Spark clusters, PySpark, Apache Iceberg, the Nessie catalog, and Apache Airflow.This role will be pivotal in evolving our data platform, including database migrations, scalable data pipelines, and governance-ready architectures for both analytical and operational use cases.Key Responsibilities : - Design and implement scalable and reliable data architectures for real-time and batch processing systems- Evaluate and recommend data tools, frameworks, and infrastructure aligned with company goals- Develop and optimize complex ETL/ELT pipelines using PySpark and Apache Airflow- Architect and manage data lakes using Spark on Apache Iceberg and Nessie catalog for versioned and governed data workflows- Perform data analysis, data profiling, data quality improvements, and data modeling- Lead database migration efforts, including planning, execution, and optimization- Define and enforce data engineering best practices, data governance standards, and schema evolution strategies- Collaborate cross-functionally with data scientists, analysts, platform engineers, and business Skills & Qualifications : - 10+ years of experience in data architecture, data engineering, data security, data governance, and big data platforms- Deep understanding of trade-offs between managed services and open-source data stack tools, including cost, scalability, operational overhead, flexibility, and vendor lock-in- Strong hands-on experience with PySpark for writing data pipelines and distributed data processing- Proven expertise with Apache Iceberg, Apache Hudi, and the Nessie catalog for modern table formats and versioned data catalogs- Experience in scaling and managing Elasticsearch and PostgreSQL clusters- Strong experience with Apache Airflow for workflow orchestration (or equivalent tools)- Demonstrated success in database migration projects across multiple cloud providers- Ability to perform deep data analysis and compare datasets between systems- Experience handling 100s of terabytes of data or more- Proficiency in SQL, data modeling, and performance tuning- Excellent communication and presentation skills, with the ability to lead technical conversationsNice to Have : - Experience in Sales, Marketing, and CRM domains, especially with Accounts and Contacts data- Knowledge in AI and vector databases.- Exposure to streaming data frameworks (Kafka, Flink, etc.)- Ability to support analytics and reporting initiativesWhy Join Us : - Work on cutting-edge data architectures using modern open-source technologies- Be part of a team transforming data operations and analytics at scale- Opportunity to architect high-impact systems from the ground up- Join a collaborative, innovation-driven culture (ref:hirist.tech)

  • Sprouts.ai - Data Engineer

    3 weeks ago

    Chandigarh, India Sprouts.ai Full time

    Job Summary :We are looking for an experienced Data Engineer to design, build, and maintain scalable data pipelines and processing systems that power our modern data platform. The ideal candidate will have hands-on expertise in distributed data processing, data lake/lakehouse systems, and workflow orchestration using modern tools such as Spark, PySpark,...

  • Data Engineer

    2 days ago

    Chandigarh, India Aspire Talent Innovations Full time

    Description :Role Purpose :Join our dynamic team to design scalable data pipelines, model decision-grade data, and deliver actionable business insights for top financial clients banks, NBFCs, lenders, and fintechs.Key Responsibilities :- Build and optimize ETL/ELT pipelines using PySpark/Python.- Design and manage data lakehouse stacks on AWS (S3, Glue,...

  • Senior ETL Data Analyst

    4 weeks ago

    Chandigarh, India emerson Full time

    Job Summary As a key contributor to our ERP Transformation Services team, the Senior ETL Data Migration Analyst is responsible for owning the design, development, and execution of enterprise-wide data migration activities. This role is instrumental in the success of global ERP implementations—primarily Oracle EBS and SAP ECC—by ensuring consistent,...

  • Senior ETL Data Analyst

    4 weeks ago

    Chandigarh, India Copeland Full time

    Job Summary As a key contributor to our ERP Transformation Services team, the Senior ETL Data Migration Analyst is responsible for owning the design, development, and execution of enterprise-wide data migration activities. This role is instrumental in the success of global ERP implementations—primarily Oracle EBS and SAP ECC—by ensuring consistent,...

  • Senior ETL Data Analyst

    3 days ago

    Chandigarh, India Emerson Full time

    Job Summary As a key contributor to our ERP Transformation Services team, the Senior ETL Data Migration Analyst is responsible for owning the design, development, and execution of enterprise-wide data migration activities. This role is instrumental in the success of global ERP implementations-primarily Oracle EBS and SAP ECC-by ensuring consistent,...

  • Senior ETL Data Analyst

    3 days ago

    Chandigarh, Chandigarh, India Emerson Full time ₹ 1,20,000 - ₹ 1,80,000 per year

    Job SummaryJOB DESCRIPTIONAs a key contributor to our ERP Transformation Services team, the Senior ETL Data Migration Analyst is responsible for owning the design, development, and execution of enterprise-wide data migration activities. This role is instrumental in the success of global ERP implementations—primarily Oracle EBS and SAP ECC—by ensuring...

  • Data Modeler

    1 week ago

    Chandigarh, India Vikash Technologies Full time

    About the Role :We are seeking a highly skilled Data Engineer / Data Modeller with deep expertise in dimensional data modelling, data warehousing, and SQL-based analytics architecture. The ideal candidate will have strong experience in designing data models optimized for business intelligence (BI), analytics, and reporting performance across platforms such...

  • Senior Data Analyst

    1 week ago

    Chandigarh, Chandigarh, India Aspire Talent Innovations Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Role : Senior Analytics Engineer (Customer Success) - Shift : 4 PM - 12 AM (Overlap with USA - Eastern Time) - Experience : 5 - 6 years (startup background strongly preferred) - Focus mix : Data Analytics 50%, Data Engineering 30%, Customer Success 20% Company Overview : We are a unified, financial-services CRM with an AI agent co-pilot that...

  • Senior Data Analyst

    1 week ago

    Chandigarh, India Aspire Talent Innovations Full time

    Role : Senior Analytics Engineer (Customer Success)- Shift : 4 PM - 12 AM (Overlap with USA - Eastern Time)- Experience : 5 - 6 years (startup background strongly preferred)- Focus mix : Data Analytics 50%, Data Engineering 30%, Customer Success 20%Company Overview :We are a unified, financial-services CRM with an AI agent co-pilot that connects fragmented...

  • Data Engineer

    2 days ago

    Chandigarh, Chandigarh, India Aspire Talent Innovations Full time ₹ 80,00,000 - ₹ 2,00,00,000 per year

    Description : Role Purpose : Join our dynamic team to design scalable data pipelines, model decision-grade data, and deliver actionable business insights for top financial clients banks, NBFCs, lenders, and fintechs.Key Responsibilities : - Build and optimize ETL/ELT pipelines using PySpark/Python. - Design and manage data lakehouse stacks on AWS...