See more Collapse

KnockCRM_Lead/Senior Data Engineer_8-15 years

2 months ago

pune, India Encora Inc. Full time

Role : Lead/Senior Data Engineer

Experience:8+ years

Primary Responsibilities:

Contribute to the detailed design and architecture of the data platform ensuring consistency, efficiency and reusability of data components and processes
Perform data cleansing and validation using SQL/Python and other tools and frameworks to remove or correct erroneous, incomplete, or inconsistent data
Responsible for applying data transformations and business logic to enhance, enrich, or standardize data
Handle large-scale and complex data sets using distributed systems & parallel computing to improve the performance of the data pipelines
Monitor, troubleshoot, and optimize the performance and cost of data pipelines
Research and evaluate tools and technologies to improve the data platform capabilities
Participate in design discussions and code reviews
Work in an Agile environment with daily stand-ups and 2 week sprints
Partner and work with DevOps, Data Science, Engineering, Product and with other internal team members
Basic Qualifications:
8+ years of Data engineering experience
Experience writing complex SQLs
Experience building data pipelines using Python
Experience building / working with cloud data platforms like Redshift / Snowflake / BigQuery
Strong attention to detail, performance and quality
Experience working in a fast-paced, Agile environment
Strong communication skills
Nice to haves:
Experience working with cloud platforms like AWS and or GCP
Experience working with Machine Learning Pipelines
Experience with prompt engineering for GenAI
Experience working with distributed programming frameworks like Apache Spark / Flink / Storm etc

We have other current jobs related to this field that you can find below

  • Senior DevOps, Experience: 8-15 years

    3 weeks ago

    Pune, India Radical Technologies Full time

    Interested candidates kindly apply before 16th September (11:30 am). CV must be in pdf format, saved with your first name. JOB DESCRIPTION: Post: Senior DevOps Experience: 8-15 years Required Skills: 8-15 years’ experience -DevOps tools like Git, Jenkins, Ansible, Docker, Kubernetes. -Good knowledge of Middleware Technologies like IIS,...

  • Senior DevOps, Experience: 8-15 years

    2 months ago

    Pune, India Radical Technologies Full time

    Interested candidates kindly apply before 16th September (11:30 am). CV must be in pdf format, saved with your first name. JOB DESCRIPTION: Post: Senior DevOps Experience: 8-15 years Required Skills: 8-15 years’ experience -DevOps tools like Git, Jenkins, Ansible, Docker, Kubernetes. -Good knowledge of Middleware Technologies like IIS,...

  • Senior DevOps, Experience: 8-15 years

    2 months ago

    pune, India Radical Technologies Full time

    Interested candidates kindly apply before 16th September (11:30 am). CV must be in pdf format, saved with your first name. JOB DESCRIPTION: Post: Senior DevOps Experience: 8-15 years Required Skills: 8-15 years’ experience -DevOps tools like Git, Jenkins, Ansible, Docker, Kubernetes. -Good knowledge of Middleware Technologies like...

  • Senior Data Engineer

    2 months ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    3 weeks ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    6 days ago

    Pune, Maharashtra, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    2 months ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    3 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Scientist

    2 months ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Scientist

    6 days ago

    Pune, Maharashtra, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Scientist

    2 months ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based...

  • Senior Data Scientist

    3 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Science Trainer

    2 months ago

    Pune, India Data Council Full time

    **About the job** We are looking for passionate and highly skilled data science trainers to be a part of our team. **Key responsibilities**: - Follow standard course content. **Skill(s) required** - Data Analytics - Data Science - Deep Learning - Machine Learning - MS-Excel - Power BI - Python - SQL - Tableau **Who can apply** 1. Minimum 1 year of...

  • Dot Net Developers, Experience: 4 to 15 years

    2 months ago

    Pune, India Radical Technologies Full time

    Interested candidates kindly apply before 16th September (11:30 am).CV must be in pdf format, saved with your first name.JOB DESCRIPTION:Post:Dot Net DevelopersExperience:4-15 yearsRequired Skills:-: 4 to 15 years of technical experience in.Net Core with Angular(4/6/8/9/….).The person should have strong hands on experience in SQL data base. We are...

  • Dot Net Developers, Experience: 4 to 15 years

    3 weeks ago

    Pune, India Radical Technologies Full time

    Interested candidates kindly apply before 16th September (11:30 am).CV must be in pdf format, saved with your first name.JOB DESCRIPTION:Post:Dot Net DevelopersExperience:4-15 yearsRequired Skills:-: 4 to 15 years of technical experience in.Net Core with Angular(4/6/8/9/….).The person should have strong hands on experience in SQL data base. We are...

  • Dot Net Developers, Experience: 4 to 15 years

    2 months ago

    Pune, India Radical Technologies Full time

    Interested candidates kindly apply before 16th September (11:30 am). CV must be in pdf format, saved with your first name. JOB DESCRIPTION: Post: Dot Net Developers Experience: 4-15 years Required Skills: -: 4 to 15 years of technical experience in .Net Core with Angular(4/6/8/9/….).  The person should have strong hands on experience in SQL...

  • Dot Net Developers, Experience: 4 to 15 years

    3 weeks ago

    Pune, India Radical Technologies Full time

    Interested candidates kindly apply before 16th September (11:30 am). CV must be in pdf format, saved with your first name. JOB DESCRIPTION: Post: Dot Net Developers Experience: 4-15 years Required Skills: -: 4 to 15 years of technical experience in .Net Core with Angular(4/6/8/9/….).  The person should have strong hands on experience in SQL...

  • Dot Net Developers, Experience: 4 to 15 years

    3 weeks ago

    pune, India Radical Technologies Full time

    Interested candidates kindly apply before 16th September (11:30 am). CV must be in pdf format, saved with your first name. JOB DESCRIPTION: Post: Dot Net Developers Experience: 4-15 years Required Skills: -: 4 to 15 years of technical experience in .Net Core with Angular(4/6/8/9/….).  The person should have strong hands on...

  • Dot Net Developers, Experience: 4 to 15 years

    6 days ago

    Pune, Maharashtra, India Radical Technologies Full time

    Interested candidates kindly apply before 16th September (11:30 am). CV must be in pdf format, saved with your first name. JOB DESCRIPTION: Post: Dot Net Developers Experience: 4-15 years Required Skills: -: 4 to 15 years of technical experience in .Net Core with Angular(4/6/8/9/....). The person should have strong hands on experience in...

  • Dot Net Developers, Experience: 4 to 15 years

    2 months ago

    pune, India Radical Technologies Full time

    Interested candidates kindly apply before 16th September (11:30 am). CV must be in pdf format, saved with your first name. JOB DESCRIPTION: Post: Dot Net Developers Experience: 4-15 years Required Skills: -: 4 to 15 years of technical experience in .Net Core with Angular(4/6/8/9/….).  The person should have strong hands on...