Sr Data Engineer 7+Yrs

3 weeks ago

bangalore, India Rangam India Full time
Job Description Description:

Sr Data Engineer:

Essential Duties and Responsibilities: This section contains a list of five to eight primary responsibilities of this role that account for 5% or more of the work. The incumbent will perform other duties assigned.
• Development of new ETL/data transformation jobs, using PySpark or Python in AWS.
• Enhancement and support on existing ETL/data transformation jobs.
• Can explain technical solutions and resolutions with internal customers and communicate feedback to the ETL team.
• Perform technical code reviews for peers moving code into production.
• Perform and review integration testing before production migrations.
• Provide high level of technical support, and perform root cause analysis for problems experienced within area of functional responsibility.
• Can document technical specs from business communications. Qualifications: To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. List knowledge, skills, and/or abilities required. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.
• 6+ years of ETL experience.
• Experience with core Python programming for data transformation.
• Intermediate-level Python and PySpark skills. Can write, read, understand and debug existing code Python and ySpark code from scratch.
• Strong knowledge of SQL fundamentals and snowflake experience, understanding of subqueries, can tune queries with execution hints to improve performance.
• Able to write SQL code sufficient for most business requirements for pulling data from sources, applying rules to the data, and stocking target data
• Proven track record in troubleshooting ETL jobs and addressing production issues like performance tuning, reject handling, and ad-hoc reloads.
• Proficient in developing optimization strategies for ETL processes.
• Basic AWS technical support skills. Has ability to log in, find existing jobs and check run status and logs
• Will run and monitor jobs running via Control-M
• Can create clear and concise documentation and communications.
• Can document technical specs from business communications.
• Ability to coordinate and aggressively follow up on incidents and problems, perform diagnosis, and provide resolution to minimize service interruption
• Ability to prioritize and work on multiple tasks simultaneously
• Effective in cross-functional and global environments to manage multiple tasks and assignments concurrently with effective communication skills.
• A self-starter who can work well independently and on team projects.
• Experienced in analyzing business requirements, defining the granularity, source to target mapping of the data elements, and full technical specification.
• Understands data dependencies and how to schedule jobs in Control-M.
• Experienced working at the command line in various flavors of UNIX, with basic understanding of shell scripting in bash and korn shell. Education and/or Experience: Include the education and experience that is necessary to perform the job satisfactorily.
• Bachelors of Science in computer science or equivalent
• 7+ years of ETL and SQL experience
• 3+ years of python and PySpark experience
• 3+ Snowflake experience
• 3+ years of AWS and unix experience
• Preferred certifications:
o AWS Certified Cloud Practitioner (amazon.com)
o Python and PySpark certifications

  • Sr Data Modeller 4 yrs RR/464/2024

    1 month ago

    Bengaluru/ Bangalore, India eMids Technologies Pvt Ltd Full time

    Apply for Sr. Data Modeller 4 Yrs RR/464/2024, Career Progress Consultants in Bengaluru/ Bangalore ,Hyderabad/ Secunderabad ,Noida/ Greater Noida for 4 - 7 Year of Experience on TimesJobs.com.

  • Sr data engineer

    2 days ago

    bangalore, India NTT DATA Services Full time

    Req ID:  286326  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Senior data engineer   ...

  • Sr data engineer

    5 hours ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 286326  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Senior data...

  • Sr. Data Engineer

    2 months ago

    bangalore, India Arting Digital Private Limited Full time

    Job Description Sr. Data EngineerExperience: 6y+Location: Trivandrum, Chennai, Pune, BangaloreBudget: 15 LPAWork Mode: On-SiteSkills:Ataccama, Syndigo, Snowflake, Databricks Requirements:6+ Yrs experience as a Data Engineer, who played a key/lead role in implementing one or two large data solutionsProgramming experience in Scala or Python, SQLMin 1+ years...

  • Data Scientists

    4 weeks ago

    bangalore, India SMARTBORN SOFTWARE CONSULTING PVT.LTD. Full time

    Role Description We are seeking experienced Data Scientists to join our team in Bengaluru. This is a full-time hybrid role, with the option to work remotely. As a Data Scientist, you will leverage advanced analytics and machine learning techniques to extract insights from large datasets. Your day-to-day tasks will include data collection, preprocessing,...

  • Sr Tableau Developer 7+Yrs

    3 weeks ago

    bangalore, India Rangam India Full time

    Job Description Description: Sr Tableau Developer Design and Development Responsibilities Visualization development in Tableau, Metadata creation and documentation Data Products, including uplift of data literacy and change management for Tableau developers within analytics systems. Drive UAT activities with business partners to ensure solutions...

  • Sr Tableau Developer 7+Yrs

    1 month ago

    bangalore, India Rangam India Full time

    Job Description Description: Sr Tableau Developer Design and Development Responsibilities Visualization development in Tableau, Metadata creation and documentation Data Products, including uplift of data literacy and change management for Tableau developers within analytics systems. Drive UAT activities with business partners to ensure solutions...

  • Technical Lead Engineer

    2 months ago

    bangalore, India [24]7.ai Full time

    Job Title: Lead Engineer (Data Engineering). Summary of Essential Job Functions Design, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow. Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud Platform. Putting...

  • Technical Lead Engineer

    3 weeks ago

    bangalore, India [24]7.ai Full time

    Job Title: Lead Engineer (Data Engineering). Summary of Essential Job Functions Design, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow. Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud Platform. Putting...

  • Senior Data Engineer

    1 month ago

    bangalore, India [24]7.ai Full time

    Job Role: Senior– Data EngineerJob Location: BangaloreWorking: HybridSummary of Essential Job FunctionsDesign, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow.Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud...

  • Senior Data Engineer

    3 weeks ago

    bangalore, India [24]7.ai Full time

    Job Role: Senior– Data EngineerJob Location: BangaloreWorking: HybridSummary of Essential Job FunctionsDesign, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow.Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud...

  • Digital Engineering Sr. Staff Engineer

    4 days ago

    bangalore, India NTT DATA Full time

    Job Description Req ID:  284003  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Sr. Staff Engineer to join our team in Bangalore, Karnātaka...

  • Sr BODS Developer

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Req ID:  248703  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr BODS Developer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job...

  • Sr BODS Developer

    3 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Req ID:  248703  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr BODS Developer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job...

  • Sr BODS Developer

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Req ID:  248703  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr BODS Developer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job...

  • Digital Engineering Sr. Engineer

    3 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Req ID:  274457  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Sr. Engineer to join our team in Bangalore, Karnātaka (IN-KA),...

  • Digital Engineering Sr. Engineer

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Req ID:  274457  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Sr. Engineer to join our team in Bangalore, Karnātaka (IN-KA),...

  • Digital Engineering Sr. Engineer

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Req ID:  274457  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Sr. Engineer to join our team in Bangalore, Karnātaka (IN-KA),...

  • Intune Jr. Engineer

    2 months ago

    bangalore, India Birlasoft Full time

    Role - Intune Engineer - Sr/JRSr. Intune Engineer- 8+ YrsJr. Intune Engineer- 5+ YrsResponsibilities:implement, and manage Microsoft Intune solutions to manage and secure devices, applications, and data.and maintain Intune policies and configurations to meet organizational security and compliance requirements.technical leadership and guidance to Intune...

  • Sr BODS Developer

    3 weeks ago

    bangalore, India NTT DATA Services Full time

    Req ID:  248703  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr BODS Developer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Requirements 6-8...