Sr Data Engineer 7+Yrs

4 weeks ago

Bengaluru, India Rangam India Full time
Job Description

Description:

Sr Data Engineer:Essential Duties and Responsibilities:

This section contains a list of five to eight primary responsibilities of this role that account for 5% or more of the work. The incumbent will perform other duties assigned.• Development of new ETL/data transformation jobs, using PySpark or Python in AWS.• Enhancement and support on existing ETL/data transformation jobs.• Can explain technical solutions and resolutions with internal customers and communicate feedback to the ETL team.• Perform technical code reviews for peers moving code into production.• Perform and review integration testing before production migrations.• Provide high level of technical support, and perform root cause analysis for problems experienced within area of functional responsibility.• Can document technical specs from business communications.

Qualifications:

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. List knowledge, skills, and/or abilities required. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.• 6+ years of ETL experience.• Experience with core Python programming for data transformation.• Intermediate-level Python and PySpark skills. Can write, read, understand and debug existing code Python and ySpark code from scratch.• Strong knowledge of SQL fundamentals and snowflake experience, understanding of subqueries, can tune queries with execution hints to improve performance.• Able to write SQL code sufficient for most business requirements for pulling data from sources, applying rules to the data, and stocking target data• Proven track record in troubleshooting ETL jobs and addressing production issues like performance tuning, reject handling, and ad-hoc reloads.• Proficient in developing optimization strategies for ETL processes.• Basic AWS technical support skills. Has ability to log in, find existing jobs and check run status and logs• Will run and monitor jobs running via Control-M• Can create clear and concise documentation and communications.• Can document technical specs from business communications.• Ability to coordinate and aggressively follow up on incidents and problems, perform diagnosis, and provide resolution to minimize service interruption• Ability to prioritize and work on multiple tasks simultaneously• Effective in cross-functional and global environments to manage multiple tasks and assignments concurrently with effective communication skills.• A self-starter who can work well independently and on team projects.• Experienced in analyzing business requirements, defining the granularity, source to target mapping of the data elements, and full technical specification.• Understands data dependencies and how to schedule jobs in Control-M.• Experienced working at the command line in various flavors of UNIX, with basic understanding of shell scripting in bash and korn shell.

Education and/or Experience:

Include the education and experience that is necessary to perform the job satisfactorily.• Bachelors of Science in computer science or equivalent• 7+ years of ETL and SQL experience• 3+ years of python and PySpark experience• 3+ Snowflake experience• 3+ years of AWS and unix experience•

Preferred certifications:o AWS Certified Cloud Practitioner (amazon.com)o Python and PySpark certifications

  • Sr Data Modeller 4 yrs RR/464/2024

    4 weeks ago

    Bengaluru, Karnataka, India eMids Technologies Pvt Ltd Full time

    Apply for Sr. Data Modeller 4 Yrs RR/464/2024, Career Progress Consultants in Bengaluru/ Bangalore ,Hyderabad/ Secunderabad ,Noida/ Greater Noida for 4 - 7 Year of Experience on

  • Sr Data Modeller 4 yrs RR/464/2024

    2 weeks ago

    Bengaluru, Karnataka, India eMids Technologies Pvt Ltd Full time

    Apply for Sr. Data Modeller 4 Yrs RR/464/2024, Career Progress Consultants in Bengaluru/ Bangalore ,Hyderabad/ Secunderabad ,Noida/ Greater Noida for 4 - 7 Year of Experience on

  • Sr Data Modeller 4 yrs RR/464/2024

    3 weeks ago

    Bengaluru/ Bangalore, India eMids Technologies Pvt Ltd Full time

    Apply for Sr. Data Modeller 4 Yrs RR/464/2024, Career Progress Consultants in Bengaluru/ Bangalore ,Hyderabad/ Secunderabad ,Noida/ Greater Noida for 4 - 7 Year of Experience on TimesJobs.com.

  • Sr. Data Engineer

    2 months ago

    Bengaluru, India Arting Digital Private Limited Full time

    Job DescriptionSr. Data EngineerExperience: 6y+Location: Trivandrum, Chennai, Pune, BangaloreBudget: 15 LPAWork Mode: On-SiteSkills: Ataccama, Syndigo, Snowflake, Databricks Requirements:6+ Yrs experience as a Data Engineer, who played a key/lead role in implementing one or two large data solutionsProgramming experience in Scala or Python, SQLMin 1+ years...

  • Sr. Data Engineer

    2 months ago

    Bengaluru, India Arting Digital Private Limited Full time

    Sr. Data EngineerExperience: 6y+Location: Trivandrum, Chennai, Pune, BangaloreBudget: 15 LPAWork Mode: On-SiteSkills: Ataccama, Syndigo, Snowflake, Databricks Requirements:6+ Yrs experience as a Data Engineer, who played a key/lead role in implementing one or two large data solutionsProgramming experience in Scala or Python, SQLMin 1+ years experience in...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India [24]7.ai Full time

    Job Role: Senior– Data Engineer Job Location: Bangalore Working: Hybrid Summary of Essential Job Functions Design, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow. Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud...

  • Technical Lead Engineer

    1 month ago

    Bengaluru, India [24]7.ai Full time

    Job Title: Lead Engineer (Data Engineering).Summary of Essential Job FunctionsDesign, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow.Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud Platform.Putting together large, intricate...

  • Technical Lead Engineer

    2 weeks ago

    Bengaluru, India [24]7.ai Full time

    Job Title: Lead Engineer (Data Engineering).Summary of Essential Job FunctionsDesign, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow.Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud Platform.Putting together large, intricate...

  • Sr Tableau Developer 7+Yrs

    4 weeks ago

    Bengaluru, India Rangam India Full time

    Job DescriptionDescription:Sr Tableau DeveloperDesign and Development ResponsibilitiesVisualization development in Tableau, Metadata creation and documentation Data Products, including uplift of data literacy and change management for Tableau developers within analytics systems. Drive UAT activities with business partners to ensure solutions meet business...

  • Sr Tableau Developer 7+Yrs

    2 weeks ago

    Bengaluru, India Rangam India Full time

    Job DescriptionDescription:Sr Tableau DeveloperDesign and Development ResponsibilitiesVisualization development in Tableau, Metadata creation and documentation Data Products, including uplift of data literacy and change management for Tableau developers within analytics systems. Drive UAT activities with business partners to ensure solutions meet business...

  • Technical Lead Engineer

    1 month ago

    Bengaluru, India [24]7.ai Full time

    Job Title: Lead Engineer (Data Engineering). Summary of Essential Job Functions Design, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow. Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud Platform. Putting together...

  • Technical Lead Engineer

    2 weeks ago

    Bengaluru, India [24]7.ai Full time

    Job Title: Lead Engineer (Data Engineering). Summary of Essential Job Functions Design, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow. Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud Platform. Putting together...

  • Data Scientists

    3 weeks ago

    Bengaluru, India SMARTBORN SOFTWARE CONSULTING PVT.LTD. Full time

    Role DescriptionWe are seeking experienced Data Scientists to join our team in Bengaluru. This is a full-time hybrid role, with the option to work remotely. As a Data Scientist, you will leverage advanced analytics and machine learning techniques to extract insights from large datasets. Your day-to-day tasks will include data collection, preprocessing,...

  • Data Scientists

    3 weeks ago

    Bengaluru, India SMARTBORN SOFTWARE CONSULTING PVT.LTD. Full time

    Role DescriptionWe are seeking experienced Data Scientists to join our team in Bengaluru. This is a full-time hybrid role, with the option to work remotely. As a Data Scientist, you will leverage advanced analytics and machine learning techniques to extract insights from large datasets. Your day-to-day tasks will include data collection, preprocessing,...

  • Sr BODS Developer

    2 weeks ago

    Bengaluru, India NTT DATA Full time

    Job DescriptionReq ID:248703NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr BODS Developer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job...

  • Sr BODS Developer

    1 week ago

    Bengaluru, India NTT DATA Full time

    Job DescriptionReq ID:248703NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr BODS Developer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India [24]7.ai Full time

    Job Role: Senior– Data EngineerJob Location: BangaloreWorking: HybridSummary of Essential Job Functions- Design, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow.- Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud Platform.-...

  • Digital Engineering Sr. Engineer

    3 weeks ago

    Bengaluru, India NTT DATA Full time

    Job DescriptionReq ID:274457NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Digital Engineering Sr. Engineer

    1 week ago

    Bengaluru, India NTT DATA Full time

    Job DescriptionReq ID:274457NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Sr Battery Test Engineer

    2 weeks ago

    Bengaluru, Karnataka, India timesjobs Full time

    Sr. Battery Test Engineer Engineer BangaloreResponsibilities:Be responsible for the design of experiments & fixtures, while conducting, recording, and reporting all battery-related test work.Be able to demonstrate technical excellence and apply first-principal engineering to new applications.Be excited to work as part of a close-knit and cohesive team to...