Sprouts.ai - Senior Data Engineer - ETL/Azure Databricks
2 weeks ago
About the Company :
Sprouts.ai is a cutting-edge seed-stage start-up focused on building a completely automated, end-to-end platform for the Go-To-Market (GTM) motion and Account Based Marketing (ABM) for B2B companies. We are currently seeking an experienced Data Scientist to join our dynamic team and play a key role in shaping our data products, our data infrastructure, our data teams, and our company.
Job Description :
At Sprouts.ai, we are seeking an experienced Senior Data Engineer to join our early-stage startup team. As a Senior Data Engineer, you will play a key role in designing, building, and optimizing our data infrastructure and analytics platforms. You will work closely with our data scientists, software engineers, and product managers to ensure the reliable collection, storage, processing, and analysis of our growing data sets.This role combines aspects of data engineering building data products while offering an exciting opportunity to shape the future of GTM and ABM for B2B companies.
Responsibilities :
- Design and develop scalable and efficient data pipelines, data processing frameworks, and ETL workflows using AWS, Databricks, Airflow, DBT
- Collaborate with cross-functional teams to gather data requirements and translate them into technical specifications and data models.
- Build and maintain data lakes and data warehouses, ensuring data quality, integrity, and security.
- Implement data governance and data management best practices to ensure data consistency, reliability, and accessibility.
- Optimize data processing and storage architectures for performance and cost efficiency, utilizing technologies such as Python, Spark, and AWS services.
- Develop and maintain monitoring and alerting systems to ensure the reliability and availability of data pipelines and analytics platforms.
- Conduct performance tuning, troubleshooting, and root cause analysis of data engineering processes and systems.
- Stay up-to-date with emerging technologies and industry trends related to data engineering and analytics, and proactively propose and implement innovative solutions.
- Mentor and provide technical guidance to junior data engineers, fostering a culture of continuous learning and growth.
- Collaborate with external partners and vendors as necessary to integrate and leverage third-party data sources or Master's degree in Computer Science, Engineering, or a related field.
- Minimum of 5 years of professional experience working as a Data Engineer in an early-stage startup or similar environment.
- Strong expertise in designing and building data processing pipelines using AWS services and Databricks.
- Experience with workflow management tools such as Apache Airflow and data integration tools like Airbyte, Meltano or custom scripting using Python.
- Excellent SQL skills for data extraction, transformation, and analysis.
- Hands-on experience with data lakes and familiarity with technologies such as Parquet, Avro, and Apache Iceberg/Hudi/Delta Table.
- Proficiency in programming languages such as Python, with experience in Spark for distributed data processing.
- In-depth knowledge of data warehousing concepts, data modeling, and schema design.
- Hands-on experience with data lakes and familiarity with technologies such as Parquet, Avro, and Apache Iceberg.
- Solid understanding of data governance, data management, and data quality principles.
- Strong problem-solving skills with the ability to analyze complex data engineering challenges and develop effective solutions.
- Familiarity with DBT (Data Build Tool) for defining and managing data transformations and data models.
- Familiarity with DevOps principles and practices, including infrastructure automation, CI/CD, and containerization.
- Excellent communication and collaboration skills, with the ability to work effectively in a fast-paced, dynamic startup environment.
- Join our team and contribute to building a cutting-edge data infrastructure that will drive our company's growth and success and tools.
(ref:hirist.tech)
-
Bangalore/Chandigarh, India Sprouts.ai Full timeAbout the Company : Sprouts.ai is a cutting-edge seed-stage start-up focused on building a completely automated, end-to-end platform for the Go-To-Market (GTM) motion and Account Based Marketing (ABM) for B2B companies. We are currently seeking an experienced Data Scientist to join our dynamic team and play a key role in shaping our data products, our data...
-
Chandigarh, India Sprouts.ai Full timeAbout SproutsSprouts.ai is a cutting-edge seed-stage start-up focused on building a completely automated, end-to-end platform for the Go-To-Market (GTM) motion and Account Based Marketing (ABM) for B2B companies. We are currently seeking an experienced Data Scientist to join our dynamic team and play a key role in shaping our data products, our data...
-
Chandigarh, India Sprouts.ai Full timeAbout Sprouts Sprouts.ai is a cutting-edge seed-stage start-up focused on building a completely automated, end-to-end platform for the Go-To-Market (GTM) motion and Account Based Marketing (ABM) for B2B companies. We are currently seeking an experienced Data Scientist to join our dynamic team and play a key role in shaping our data products, our data...
-
Sprouts.ai - Scrum Master
4 days ago
Chandigarh, India Sprouts.ai Full timeAbout the Role : As the Scrum Master at Sprouts.ai, you will play a pivotal role in ensuring the successful delivery of software products by facilitating and managing agile processes. With a minimum of 8 years of experience, you will work closely with Development, QA, and Product teams to ensure smooth execution of sprints and continuous improvement in our...
-
Chandigarh, India Sprouts.ai Full timeRole : Software Quality Assurance Team : the Role : As the Software Quality Assurance Team Lead at Sprouts.ai, you will be responsible for leading Quality Assurance team and ensuring the delivery of high-quality software products. With a minimum of 5 years of experience in Quality Assurance, you will work in both, manual and automation testing, driving...
-
Chandigarh, India Sprouts.ai Full timeRole : Software Quality Assurance Team : the Role :As the Software Quality Assurance Team Lead at Sprouts.ai, you will be responsible for leading Quality Assurance team and ensuring the delivery of high-quality software products. With a minimum of 5 years of experience in Quality Assurance, you will work in both, manual and automation testing, driving...
-
Chandigarh, India Sprouts.ai Full timeRole : Software Quality Assurance Team : the Role : As the Software Quality Assurance Team Lead at Sprouts.ai, you will be responsible for leading Quality Assurance team and ensuring the delivery of high-quality software products. With a minimum of 5 years of experience in Quality Assurance, you will work in both, manual and automation testing, driving...
-
chandigarh, India Sprouts.ai Full timeRole : Software Quality Assurance Team : the Role : As the Software Quality Assurance Team Lead at Sprouts.ai, you will be responsible for leading Quality Assurance team and ensuring the delivery of high-quality software products. With a minimum of 5 years of experience in Quality Assurance, you will work in both, manual and automation testing, driving...
-
Chandigarh, India Sprouts.ai Full timeRole : Software Quality Assurance Team : the Role :As the Software Quality Assurance Team Lead at Sprouts.ai, you will be responsible for leading Quality Assurance team and ensuring the delivery of high-quality software products. With a minimum of 5 years of experience in Quality Assurance, you will work in both, manual and automation testing, driving...
-
chandigarh, India Sprouts.ai Full timeRole : Software Quality Assurance Team : the Role : As the Software Quality Assurance Team Lead at Sprouts.ai, you will be responsible for leading Quality Assurance team and ensuring the delivery of high-quality software products. With a minimum of 5 years of experience in Quality Assurance, you will work in both, manual and automation testing, driving...
-
Chandigarh, India Sprouts.ai Full timeAbout the Role : As the SDET Manager at Sprouts.ai, you will be responsible for leading our Quality Assurance department and ensuring the delivery of high-quality software products. With a minimum of 10 years of experience in Quality Assurance, you will oversee both manual and automation testing efforts, driving efficiency, and maintaining the highest...
-
Chandigarh, India Sprouts.ai Full timeAbout the Role :As the SDET Manager at Sprouts.ai, you will be responsible for leading our Quality Assurance department and ensuring the delivery of high-quality software products. With a minimum of 10 years of experience in Quality Assurance, you will oversee both manual and automation testing efforts, driving efficiency, and maintaining the highest...
-
chandigarh, India Sprouts.ai Full timeDuties / Responsibilities :- Attend all agile ceremonies.- Analyze functional and technical requirement specifications.- Create, document, and maintain test plans and authoring test scripts based on the Jira stories and Acceptance Criteria for multi-browser web front-end and API testing.- Identify, analyze, and report software defects and issues, working...
-
Chandigarh, India Sprouts.ai Full timeDuties / Responsibilities :- Attend all agile ceremonies.- Analyze functional and technical requirement specifications.- Create, document, and maintain test plans and authoring test scripts based on the Jira stories and Acceptance Criteria for multi-browser web front-end and API testing.- Identify, analyze, and report software defects and issues, working...
-
Chandigarh, India Sprouts.ai Full timeDuties / Responsibilities :- Attend all agile ceremonies.- Analyze functional and technical requirement specifications.- Create, document, and maintain test plans and authoring test scripts based on the Jira stories and Acceptance Criteria for multi-browser web front-end and API testing.- Identify, analyze, and report software defects and issues, working...
-
Chandigarh, India Sprouts.ai Full timeDuties / Responsibilities :- Attend all agile ceremonies.- Analyze functional and technical requirement specifications.- Create, document, and maintain test plans and authoring test scripts based on the Jira stories and Acceptance Criteria for multi-browser web front-end and API testing.- Identify, analyze, and report software defects and issues, working...
-
Chandigarh, India Sprouts.ai Full timeDuties / Responsibilities :- Attend all agile ceremonies.- Analyze functional and technical requirement specifications.- Create, document, and maintain test plans and authoring test scripts based on the Jira stories and Acceptance Criteria for multi-browser web front-end and API testing.- Identify, analyze, and report software defects and issues, working...
-
Chandigarh, India Sprouts.ai Full timeDuties / Responsibilities :- Attend all agile ceremonies.- Analyze functional and technical requirement specifications.- Create, document, and maintain test plans and authoring test scripts based on the Jira stories and Acceptance Criteria for multi-browser web front-end and API testing.- Identify, analyze, and report software defects and issues, working...
-
Senior Data Engineer
2 weeks ago
Chandigarh, India Basware Full timeJob DescriptionIn this role, you will be responsible for processing data, developing and maintaining big data pipelines, and enhancing data quality and efficiency. As aSenior Data Engineer, you are a key contributor in our Product Development team focused on Data and Analytics. This position involves combining data from various sources, designing and...
-
Senior Data Engineer
5 days ago
Chandigarh, Chandigarh, India Basware Full timeJob Description In this role, you will be responsible for processing data, developing and maintaining big data pipelines, and enhancing data quality and efficiency. As a Senior Data Engineer , you are a key contributor in our Product Development team focused on Data and Analytics. This position involves combining data from various sources, designing and...
