Practice Lead Data Engineer

Title: Senior Data Engineer

Practice: Data Engineering & AI

Location: Office (Pune / Mohali / Hyderabad)

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes to support downstream analytics and AI applications.
• Collaborate with ML Engineers to integrate data solutions into machine learning models and workflows.
• Work closely with clients to understand their data requirements and deliver tailored data solutions.
• Ensure data quality, integrity, and security across all projects.
• Optimize and manage data storage solutions in cloud environments (AWS, Azure, GCP).
• Utilize Databricks for data processing and analytics tasks, leveraging its capabilities to enhance data workflows.
• Monitor the performance of data pipelines, identify bottlenecks or failures, and implement improvements to enhance efficiency and reliability.
• Implement best practices for data engineering, including documentation, testing, and version control.
• Troubleshoot and resolve data-related issues in a timely manner.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 10+ years of experience as a Data Engineer or in a similar role.
• Strong proficiency in SQL, Python, and other relevant programming languages.
• Hands-on experience with Databricks and its ecosystem.
• Familiarity with major cloud environments (AWS, Azure, GCP) and their data services.
• Experience with data warehousing solutions like Snowflake, Redshift, or BigQuery.
• Comfortable working with a variety of SQL, NoSQL and graph databases like PostgreSQL and MongoDB;
• Knowledge of data integration tools.
• Understanding of data modeling, data architecture, and database design.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Highly Desirable Skills

• Experience with real-time data processing frameworks (e.g., Apache Kafka, Spark Streaming).
• Knowledge of data visualization tools (e.g., Tableau, Power BI).
• Familiarity with machine learning concepts and frameworks.
• Experience working in a client-facing role.

Company Description: Bits in Glass - India

• Industry Leader:
• Bits in Glass(BIG) has been in business for more than 20 years. In 2021 Bits in Glass joined hands with Crochet Technologies, forming a larger organization under the Bits In Glass brand to better serve customers across the globe.
• Offices across three locations in India: Pune, Hyderabad & Chandigarh.
• Specialized Pega partner since 2017 , delivering Pega solutions with deep industry expertise and experience.
• Proudly ranked among the top 30 Pega partners, Bits In Glass has been one of the very few sponsors of the annual PegaWorld event.
• Elite Appian partner since 2008 , delivering Appian solutions with deep industry expertise and experience.
• Operating in the United States, Canada, United Kingdom, and India.
• Dedicated global Pega CoE to support our customers and internal dev teams.
• Employee Benefits:
• Career Growth: Opportunities for career advancement and professional development.
• Challenging Projects: Work on innovative, cutting-edge projects that make a global impact.
• Global Exposure: Collaborate with international teams and clients to broaden your professional network.
• Flexible Work Arrangements: Support for work-life balance through flexible working conditions.
• Comprehensive Benefits: Competitive compensation packages and comprehensive benefits including health insurance, and paid time off.
• Learning Opportunities- Great opportunity to upskill yourself and work on new technologies like AI-enabled Pega solutions, Data engineering, Integration, cloud migration etc.
• Company Culture:
• Collaborative Environment: Emphasizes teamwork, innovation, and knowledge sharing.
• Inclusive Workplace: Values diversity and fosters an inclusive environment where all ideas are respected.
• Continuous Learning: Encourages professional development through ongoing learning opportunities and certifications.
• Core Values:
• Integrity: Commitment to ethical practices and transparency in all business dealings.
• Excellence: Strive for the highest standards in everything we do.
• Client-Centric Approach: Focus on delivering the best solutions tailored to client needs.
• Join Us:
• Be part of a team that transforms businesses and drives innovation.
• Apply today and take the next step in your professional journey with Bits in Glass India
• Connect with us on LinkedIn and visit BIG Life to find out more.