Sr. Data Engineer

Found in: beBee S IN - 1 month ago


Work at Home, India Concentrix Full time

Job Title:

Sr. Data Engineer - Data Platform

Job Description

We are currently looking for a dynamic, professional, team-oriented, self-motivated individual with excellent communication skills and a positive attitude to join our Data Engineering team. This is a senior level position, and the individual plays a critical role in defining the data structures, developing integrations, ETL, storage, and usage of data within an organization.

The Sr. Data Engineer role within Concentrix is responsible for designing, developing, implementing, and supporting data integration and outbound interfaces for the Enterprise Data Platform. The role is responsible for the implementation, integration, and expansion of the Data Platform system using big data, cloud technology and other trending technologies. The Sr. Data Engineer is expected to have extensive technical knowledge and experience in multiple core technology areas and integration, along with strong planning, communication, and analytical skills. As a senior member of the team, the individual will provide guidance and technical leadership to the software engineers following Agile software engineering and development practices.

Essential Duties:

  • Actively participate in the design, development, testing and implementation of the models, data integration, ETL, interfaces, data governance, and data quality standards.
  • Design, develop and implement scalable and efficient databases, data warehouses, and data lakes to support business needs and analytics initiatives. Excellent understanding of dimensional data modeling, RDBMS and NoSQL platforms.
  • Responsible for managing the full life cycle of data warehouse and big data solutions. This includes creating the requirements analysis, the platform selection, design of the data platform, development, testing, and deployment of the proposed solution.
  • Collaborate with stakeholders, such as business analysts, data scientists, and IT teams, to understand data requirements and translate them into effective data solutions.
  • Benchmark systems, analyze system bottlenecks and propose solutions to eliminate them.
  • Evaluate and select appropriate technologies, tools, and platforms to support the organization's data architecture strategy.
  • Guide/Mentor/Assist in development of the proposed data solutions.
  • Conduct code reviews to maintain code quality and consistency across the team.
  • Create and maintain technical documentation for the data projects.
  • Lead performance tuning and optimization activities of the data systems to ensure high availability, reliability, and efficiency.
  • Lead the team in infrastructure setup phases.
  • Take end-to-end ownership for solution components and bring in design best practices and tools.  Define data integration and ETL (Extract, Transform, Load) processes to ensure smooth data flow between systems and data sources.
  • Establish and enforce data governance practices, including data security, data privacy, and data access controls.
  • Stay updated with emerging trends, best practices, and technologies in the data architecture field and recommend improvements to enhance data management capabilities.
  • Experience working in Agile or Scrum development environments.

Skills:

  • Minimum of 7 years' work experience as a Data Engineer.
  • Minimum 5+ yearsâ experience in Data Warehouse design and development for large-scale complex Data Platform.  Experience with star schemas, dimensional modeling, and extract transform load (ETL) design and development. 
  • Knowledge of data modeling using Kimbal and Inmon methodologies
  • Recent 5+ years in Big Data Ecosystem.  Expertise in cloud-based data platforms, such as Google, AWS, & Azure. In-depth knowledge of data modeling concepts and techniques, including relational, dimensional, and NoSQL data models.
  • Python expert responsible for designing, coding, deploying and debugging development projects related to data pipelines that formulate data for valuable insights.
  • Proven experience in the design, development, and implementation of complex data warehouse/data mart environments.
  • Expert understanding of architectural and data warehouse design principles and data integration.
  • Experience with major big data solutions like Hadoop, Hive, and MongoDB.
  • Experience with open table formats like Iceberg, Hudi and Delta.
  • Understanding of major programming/scripting languages like Java and/or R.
  • Expert with data integration technologies like Kafka and Spark.
  • Knowledgeable of any of the ETL technologies like Pentaho, SSIS, Informatica or DataStage.
  • Experience working with RDBMS like Oracle, SQL Server, MySQL and Postgres.
  • Excellent team player with a proven background of individual contribution. Strong track record in building strong relationships.
  • Detail-oriented with very good organization and project management skills.
  • Must be comfortable communicating with all levels of the organization, have good interpersonal skills, and display good team work ethics.
  • Must be self-motivated, problem-solver with analytical skills with the ability to multi-task while meeting deadlines.
  • Knowledge of data governance practices, data security, and privacy regulations (e.g., GDPR, CCPA).

Location:

India Pune, Maharashtra

Language Requirements:

Time Type:

Full time

If you are a California resident, by submitting your information, you acknowledge that you have read and have access to the Job Applicant Privacy Notice for California Residents