Sprouts.ai - Senior Data Engineer - ETL/Azure Databricks

2 weeks ago

BangaloreChandigarh, India Sprouts.ai Full time

About the Company :

Sprouts.ai is a cutting-edge seed-stage start-up focused on building a completely automated, end-to-end platform for the Go-To-Market (GTM) motion and Account Based Marketing (ABM) for B2B companies. We are currently seeking an experienced Data Scientist to join our dynamic team and play a key role in shaping our data products, our data infrastructure, our data teams, and our company.

Job Description :

At Sprouts.ai, we are seeking an experienced Senior Data Engineer to join our early-stage startup team. As a Senior Data Engineer, you will play a key role in designing, building, and optimizing our data infrastructure and analytics platforms. You will work closely with our data scientists, software engineers, and product managers to ensure the reliable collection, storage, processing, and analysis of our growing data sets.This role combines aspects of data engineering building data products while offering an exciting opportunity to shape the future of GTM and ABM for B2B companies.

Responsibilities :

  • Design and develop scalable and efficient data pipelines, data processing frameworks, and ETL workflows using AWS, Databricks, Airflow, DBT
  • Collaborate with cross-functional teams to gather data requirements and translate them into technical specifications and data models.
  • Build and maintain data lakes and data warehouses, ensuring data quality, integrity, and security.
  • Implement data governance and data management best practices to ensure data consistency, reliability, and accessibility.
  • Optimize data processing and storage architectures for performance and cost efficiency, utilizing technologies such as Python, Spark, and AWS services.
  • Develop and maintain monitoring and alerting systems to ensure the reliability and availability of data pipelines and analytics platforms.
  • Conduct performance tuning, troubleshooting, and root cause analysis of data engineering processes and systems.
  • Stay up-to-date with emerging technologies and industry trends related to data engineering and analytics, and proactively propose and implement innovative solutions.
  • Mentor and provide technical guidance to junior data engineers, fostering a culture of continuous learning and growth.
  • Collaborate with external partners and vendors as necessary to integrate and leverage third-party data sources or Master's degree in Computer Science, Engineering, or a related field.
  • Minimum of 5 years of professional experience working as a Data Engineer in an early-stage startup or similar environment.
  • Strong expertise in designing and building data processing pipelines using AWS services and Databricks.
  • Experience with workflow management tools such as Apache Airflow and data integration tools like Airbyte, Meltano or custom scripting using Python.
  • Excellent SQL skills for data extraction, transformation, and analysis.
  • Hands-on experience with data lakes and familiarity with technologies such as Parquet, Avro, and Apache Iceberg/Hudi/Delta Table.
  • Proficiency in programming languages such as Python, with experience in Spark for distributed data processing.
  • In-depth knowledge of data warehousing concepts, data modeling, and schema design.
  • Hands-on experience with data lakes and familiarity with technologies such as Parquet, Avro, and Apache Iceberg.
  • Solid understanding of data governance, data management, and data quality principles.
  • Strong problem-solving skills with the ability to analyze complex data engineering challenges and develop effective solutions.
  • Familiarity with DBT (Data Build Tool) for defining and managing data transformations and data models.
  • Familiarity with DevOps principles and practices, including infrastructure automation, CI/CD, and containerization.
  • Excellent communication and collaboration skills, with the ability to work effectively in a fast-paced, dynamic startup environment.
  • Join our team and contribute to building a cutting-edge data infrastructure that will drive our company's growth and success and tools.

(ref:hirist.tech)

  • Sprouts.ai - Senior Data Engineer - ETL/Azure Databricks

    2 weeks ago

    chandigarh, India Sprouts.ai Full time

    About the Company : Sprouts.ai is a cutting-edge seed-stage start-up focused on building a completely automated, end-to-end platform for the Go-To-Market (GTM) motion and Account Based Marketing (ABM) for B2B companies. We are currently seeking an experienced Data Scientist to join our dynamic team and play a key role in shaping our data products, our data...

  • Senior Azure Data Engineer

    3 weeks ago

    Mumbai/Bangalore, India Techno Wise Full time

    Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...

  • Senior Azure Data Engineer

    2 months ago

    Mumbai/Bangalore, Maharashtra, India Techno Wise Full time

    Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...

  • Senior Azure Data Engineer

    2 months ago

    Mumbai/Bangalore, India Techno Wise Full time

    Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...

  • Senior Azure Data Engineer

    3 weeks ago

    Mumbai/Bangalore, Maharashtra, India Techno Wise Full time

    Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...

  • Sprouts.ai - Machine Learning Engineer - Artificial Intelligence

    3 weeks ago

    Chandigarh, India Sprouts.ai Full time

    About SproutsSprouts.ai is a cutting-edge seed-stage start-up focused on building a completely automated, end-to-end platform for the Go-To-Market (GTM) motion and Account Based Marketing (ABM) for B2B companies. We are currently seeking an experienced Data Scientist to join our dynamic team and play a key role in shaping our data products, our data...

  • Sprouts.ai - Machine Learning Engineer - Artificial Intelligence

    2 weeks ago

    Chandigarh, India Sprouts.ai Full time

    About Sprouts Sprouts.ai is a cutting-edge seed-stage start-up focused on building a completely automated, end-to-end platform for the Go-To-Market (GTM) motion and Account Based Marketing (ABM) for B2B companies. We are currently seeking an experienced Data Scientist to join our dynamic team and play a key role in shaping our data products, our data...

  • Azure Databricks Engineer

    2 months ago

    Bangalore, India ResourceTree Global Services Full time

    Job Title : Senior Databricks Data EngineerSkillset : Databricks, Datalake Architecture, AzureExperience : 6 - 8 yearsLocation : ChennaiJob Summary : We are seeking an experienced Senior Databricks Data Engineer with a very good understanding of Databricks, Lakehouse concepts, with architecture experience, and a sound knowledge of Azure and its services....

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    3 weeks ago

    Bangalore, India NTT DATA Services Full time

    Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’ experience...

  • Sprouts.ai - Scrum Master

    4 days ago

    Chandigarh, India Sprouts.ai Full time

    About the Role : As the Scrum Master at Sprouts.ai, you will play a pivotal role in ensuring the successful delivery of software products by facilitating and managing agile processes. With a minimum of 8 years of experience, you will work closely with Development, QA, and Product teams to ensure smooth execution of sprints and continuous improvement in our...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...

  • ETL Data Engineer

    2 months ago

    Bangalore, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

  • ETL Data Engineer

    3 weeks ago

    Bangalore, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

  • ETL Data Engineer

    2 months ago

    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

  • ETL Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

  • Lead Azure Databricks Engineer

    2 months ago

    Bangalore, India ResourceTree Global Services Full time

    Resource Tree Global Services Pvt Ltd is hiring Senior Databricks Data Engineer for one of its leading client in Content & Data Analytics. Below are the details .Job Title : Senior Databricks Data EngineerSkills Required : Azure, Databricks, Datalake, Python/Scala/Java, Data Migration Strategies, Data Warehiusing, Data Modelling, Strong knowledge on Data...

  • Azure Databricks Engineer

    2 months ago

    bangalore, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...

  • Azure Databricks Engineer

    6 days ago

    bangalore, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical LeadExperience: 5-10 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, India Growel Softech Pvt. Ltd. Full time

    Job Title: Azure Data Engineer. Location: Bangalore, India. Experience Level: 4-8 years. Job Description:. We are looking for an experienced Azure Data Engineer to join our team in Bangalore. As an Azure Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Azure Data Factory,...

  • Senior Data Engineer

    2 months ago

    bangalore, India Growel Softech Pvt. Ltd. Full time

    Job Title: Azure Data Engineer. Location: Bangalore, India. Experience Level: 4-8 years. Job Description:. We are looking for an experienced Azure Data Engineer to join our team in Bangalore. As an Azure Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Azure Data Factory,...