Technical Specialist, Data Engineering

2 weeks ago

Bengaluru, India Carrier Full time

About the role

Experienced Cloud Operations professional. Oversees the cost/benefit analysis to determine the financial, operational, and technical feasibility of adopting external cloud-based IT platforms and infrastructure services. Manages the implementation of cloud services and integration with in-house applications and systems.

Key Responsibilities:

As a Technical specialist, you’ll be responsible for:

Data Strategy Development:  Collaborating with senior management and other stakeholders to develop a comprehensive data strategy aligned with the organization's business goals and objectives.

Data Modeling:  Designing and implementing data models that represent the structure, relationships, and constraints of the organization's data assets. This involves creating conceptual, logical, and physical data models to support various business processes and applications.

Database Design and Optimization:  Designing and optimizing database systems to ensure efficient storage, retrieval, and manipulation of data. This includes selecting appropriate database technologies, configuring database servers, and tuning database performance for optimal throughput and responsiveness.

Data Integration:  Designing and implementing data integration solutions to facilitate the seamless flow of data between different systems, applications, and databases. This may involve using Extract, Transform, Load (ETL) tools, data replication techniques, or application programming interfaces (APIs) to integrate disparate data sources.

Data Governance:  Establishing data governance policies, standards, and procedures to ensure the integrity, security, and quality of the organization's data assets. This involves defining data management practices, enforcing data compliance requirements, and implementing data quality controls.

Metadata Management:  Developing and maintaining metadata repositories to catalog and organize metadata about the organization's data assets. This includes capturing metadata attributes such as data lineage, data definitions, and data ownership to facilitate data discovery and understanding.

Data Security and Privacy:  Implementing data security measures and privacy controls to protect sensitive and confidential data from unauthorized access, disclosure, or misuse. This involves implementing encryption, access controls, and data masking techniques to safeguard data assets.

Data Architecture Documentation:  Creating and maintaining documentation of the organization's data architecture, including data models, data flow diagrams, and system architecture diagrams. This documentation serves as a reference for stakeholders and helps ensure consistency and alignment across the organization.

Data Quality Management:  Establishing data quality standards and processes to monitor, measure, and improve the quality of the organization's data assets. This involves identifying data quality issues, implementing data cleansing and enrichment techniques, and establishing data quality metrics and KPIs.

Collaboration and Communication:  Collaborating with cross-functional teams, including business analysts, software developers, and database administrators, to understand data requirements and ensure alignment with business needs. Effective communication skills are essential for conveying complex technical concepts to non-technical stakeholders.

Technology Evaluation and Selection:  Researching and evaluating emerging technologies and tools in the field of data management and analytics. This includes assessing the suitability of different technologies for specific use cases, conducting proof-of-concept evaluations, and making recommendations for technology adoption.

Continuous Learning and Development:  Keeping abreast of industry trends, best practices, and advancements in data architecture and data management. This involves attending conferences, participating in training programs, and pursuing professional certifications to enhance skills and knowledge in the field.

Requirements

We are looking for people who are

Work on Data ingestion, handling database and work on ETL workflows

Data Ingestion:

Develop and maintain data ingestion pipelines.

Extract data from various sources (databases, APIs, logs, etc.). Transform and clean data as needed before loading it into Redshift. Schedule and automate data ingestion processes. Monitor and optimise data ingestion performance.

AWS Redshift:

Set up and configure Redshift clusters based on workload requirements. Tune and optimize query performance through indexing and distribution strategies. Monitor and manage Redshift performance, including workload management and query optimization. Implement security measures and access controls for Redshift. Ensure high availability and disaster recovery for Redshift clusters.

ETL (Extract, Transform, Load):

Develop ETL workflows using AWS Glue, Apache Spark, or other relevant tools. Transform and enrich data during the ETL process to meet business requirements. Handle schema evolution and data versioning in ETL pipelines. Monitor ETL job performance and troubleshoot issues. Implement data lineage and metadata management.

Minimum Requirements:

Strong understanding of data engineering concepts and best practices. More than 13 years of experience in similar technical roles Proficiency in SQL and experience with data modeling techniques. Familiarity with AWS services, particularly Redshift, S3, and Glue. Knowledge of ETL (Extract, Transform, Load) processes and tools. Excellent problem-solving and troubleshooting skills. Strong communication skills to collaborate with cross-functional teams. Strong experience with Python or similar and Javascript highly preferred

Benefits

We are committed to offering competitive benefits programs for all of our employees, and enhancing our programs when necessary.

Enjoy your best years with our retirement savings plan Have peace of mind and body with our health insurance Make yourself a priority with flexible schedules, parental leave and our holiday purchase scheme Drive forward your career through professional development opportunities Achieve your personal goals with our Employee Assistance Programme

Our commitment to you

Our greatest assets are the expertise, creativity and passion of our employees. We strive to provide a great place to work that attracts, develops and retains the best talent, promotes employee engagement, fosters teamwork and ultimately drives innovation for the benefit of our customers. We strive to create an environment where you feel that you belong, with diversity and inclusion as the engine to growth and innovation. We develop and deploy best-in-class programs and practices, providing enriching career opportunities, listening to employee feedback and always challenging ourselves to do better. This is .

  • Specialist - Data Engineering

    3 weeks ago

    Bengaluru, India LTIMindtree Full time

    Specialist - Data EngineeringJob Req Id: 1271392 Azure,Pyspark, Kafka, Spark, SQL ,PythonMin Salary: Max Salary:Job Segment:Database, SQL, Engineer, Technology, Engineering

  • Lead Technical Specialist

    1 month ago

    Bengaluru, India Altair Engineering Full time

    Transforming the Future with the Convergence of Simulation and Data Lead Technical Specialist - SAS Do you like a challenge, are you a complex thinker who likes to solve problems? If so, then you might be the new Altairian we are searching for. At Altair, your curiosity matters. We pride ourselves on a business culture that enables open, creative...

  • Technical Specialist

    1 week ago

    Bengaluru, India FRI FIL India Business and Research Services Private Limited Full time

    Description Data Services Group is part of the Technology Infrastructure Services (TIS) function and is responsible for providing a secure, real-time and agile Enterprise Data Platform. As part of our Relational Data Services, we provide data storage and retrieval, security, replication and migration and HA/DR services through multi-vendor relational...

  • Technical Specialist

    4 days ago

    Bengaluru, Karnataka, India NatWest Digital X Full time

    Join us as a Technical Specialist AnalystThis is a rewarding opportunity for a passionate and driven analyst to join our businessWe'll look to you to apply your specialist skill and knowledge to solve business problems and produce working solutions that will make a difference to our customers and the bankHone your technical expertise in a collaborative,...

  • Leader (Specialist), Data & AI

    6 days ago

    Bengaluru, India Databricks Full time

    FEQ225R60As aLeader(Strategic Accounts, Data & AI) willlead a teamofSpecialist Solutions Architects(Data & AI), who are Subject Matter Experts in Big Data / Data Engineering / AI & ML, focusing on large enterprise & strategic customers in India. You will help lead our APJ Region (Asia Pacific and Japan) expansion, building and lead a technical specialist...

  • Technical Specialist

    3 weeks ago

    Bengaluru, Karnataka, India ABB Full time

    Technical Specialist - Offshore WindTake your next career step at ABB with a global team that is energizing the transformation of society and industry to achieve a more productive, sustainable future.At ABB, we have the clear goal of driving diversity and inclusion across all dimensions: gender, LGBTQ+, abilities, ethnicity and generations. Together, we are...

  • Leader (Specialist), Data & AI

    1 week ago

    Bengaluru, India Databricks Full time

    FEQ225R60As a Leader (Strategic Accounts, Data & AI) will lead a team of Specialist Solutions Architects (Data & AI), who are Subject Matter Experts in Big Data / Data Engineering / AI & ML, focusing on large enterprise & strategic customers in India. You will help lead our APJ Region (Asia Pacific and Japan) expansion, building and lead a technical...

  • Senior Technical Specialist

    1 week ago

    Bengaluru, Karnataka, India ABB Full time

    Senior Technical Specialist - PM DrivesTake your next career step at ABB with a global team that is energizing the transformation of society and industry to achieve a more productive, sustainable future.At ABB, we have the clear goal of driving diversity and inclusion across all dimensions: gender, LGBTQ+, abilities, ethnicity and generations. Together, we...

  • Trade Compliance Data Specialist I

    3 weeks ago

    Bengaluru, India Mouser Electronics Full time

    JOB DESCRIPTIONTitle:Trade Compliance Data Specialist ILocation:IndiaThe mission of the Technical Data Group is to provide the most accurate and complete data for design engineers sourcing components on Mouser.com. The group performs data collection for Semiconductors, Electronic Components, Supplies and Equipment utilizing manufacturer datasheets and...

  • Senior Solutions Engineer

    1 month ago

    Bengaluru, India Altair Engineering Full time

    Job Summary: This position in Altair’s Global Technical Team will support technical pre and post sales activities for our worldwide customer base. You will be contributing to the success of a team of engineering specialists and account managers in the different countries by increasing the deployment of Altair's solutions dedicated to linear...

  • Technical Solns.Arch. Specialist Advisor

    1 week ago

    Bengaluru, India NTT DATA Full time

    Job Description Technical Architect for Network & Network SecurityTechnical Architect for Network & Network SecurityTechnical Architect for Network & Network Security Apply from local Career site Listen to the story of Employee Voice Vijay Bhambri Operations Manager India Read more Alex Gruber Sales Executive United States Read more Alejandra...

  • Senior Technical Writer

    1 month ago

    Bengaluru, India Altair Engineering Full time

    Job Summary: Altair Engineering is seeking an experienced software technical writer to join the Altair technical documentation team. We’re looking for someone smart, energetic, and self-motivated who can collaborate effectively in a remote working environment. Critical skills for this position include solid experience documenting software user...

  • Specialist - Data Engineering

    1 month ago

    Bengaluru, India LTIMindtree Full time

    Specialist - Data Engineering Job Req Id: 1271392 Azure,Pyspark, Kafka, Spark, SQL ,Python Min Salary: Max Salary: Job Segment: Database, SQL, Engineer, Technology, Engineering

  • Trade Compliance Data Specialist I

    4 weeks ago

    Bengaluru, India Mouser Electronics Full time

    JOB DESCRIPTION Title: Trade Compliance Data Specialist I Location:  IndiaThe mission of the Technical Data Group is to provide the most accurate and complete data for design engineers sourcing components on Mouser.com. The group performs data collection for Semiconductors, Electronic Components, Supplies and Equipment utilizing manufacturer...

  • Systems Integration Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements5+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on Apache Spark or...

  • Technical Specialist- Hydrogen Process

    3 weeks ago

    Bengaluru, Karnataka, India ABB Full time

    Technical Specialist- Hydrogen ProcessTake your next career step at ABB with a global team that is energizing the transformation of society and industry to achieve a more productive, sustainable future.At ABB, we have the clear goal of driving diversity and inclusion across all dimensions: gender, LGBTQ+, abilities, ethnicity and generations. Together, we...

  • Technical Services Engineers

    2 weeks ago

    Bengaluru, Karnataka, India timesjobs Full time

    Technical Services Engineers - Various PositionsPosition:The Technical Service Engineer reports to Manager - Technical services. We are currently looking for engineers in the following disciplines;AvionicsPower plantSpecifically, the Technical Services Engineer will;Provide technical support of activities prior to aircraft delivery.Supply technical services...

  • Technical Solns.Arch. Specialist Advisor

    6 days ago

    Bengaluru, India NTT DATA Full time

    Job DescriptionTechnical Architect for Network & Network SecurityTechnical Architect for Network & Network SecurityTechnical Architect for Network & Network SecurityApply from local Career siteListen to the story of Employee VoiceVijay BhambriOperations ManagerIndiaRead moreAlex GruberSales ExecutiveUnited StatesRead moreAlejandra PeraltaLegal...

  • Technical Solns.Arch. Specialist Advisor

    6 days ago

    Bengaluru, India NTT DATA Services Full time

    Technical Architect for Network & Network SecurityTechnical Architect for Network & Network SecurityTechnical Architect for Network & Network Security

  • Technical Solns.Arch. Specialist Advisor

    1 week ago

    Bengaluru, India NTT DATA Services Full time

    Technical Architect for Network & Network SecurityTechnical Architect for Network & Network SecurityTechnical Architect for Network & Network Security