It Data Engineer

The IT Data Engineer plays a critical role in enabling data-driven decision-making across the organization by designing building and maintaining robust data infrastructure This position is responsible for developing scalable data pipelines managing databases and data warehouses and ensuring the integrity accessibility and quality of enterprise data Through thoughtful architecture and efficient processing systems the Data Engineer supports analytical initiatives and empowers teams with reliable well-organized data assets Key Responsibilities Design build and maintain scalable data pipelines to extract transform and load data from diverse sources into centralized repositories e g data warehouses data lakes Develop and manage databases data warehouses and data lakes to support analytics and reporting needs Write and maintain efficient code and scripts for data processing transformation and manipulation Ensure data quality consistency and reliability across all systems and pipelines Implement and uphold data security privacy and access controls in compliance with governance standards Collaborate with cross-functional teams to deliver data solutions aligned with business objectives Monitor and optimize the performance scalability and cost-efficiency of data infrastructure Create and maintain clear documentation for data architecture processes and workflows Stay current with emerging data engineering technologies and recommend improvements to existing systems Design and implement data models and schemas to support analytical and machine learning use cases Build curated datasets and data marts to enable self-service analytics for business users Establish monitoring and alerting systems to proactively detect and resolve data pipeline issues Support machine learning operations by collaborating with data scientists on feature engineering and model deployment Leverage cloud platforms e g AWS Azure GCP to build and maintain modern scalable data infrastructure Contribute to data governance initiatives by ensuring compliance with internal policies and external regulations While the job description describes what is anticipated as the requirements of the position the job requirements are subject to change based upon any changing needs and requirements of the business Required Skills Proficiency in designing building and supporting large-scale data warehouses using cloud platforms such as Azure AWS or Google Cloud Strong experience with Big Data technologies e g Snowflake Hadoop Spark data modeling OLTP OLAP and database design and management Skilled in writing and debugging complex SQL scripts and Python-based data processing using libraries such as Pandas and PySpark Hands-on experience with ETL ELT processes orchestration tools e g Apache Airflow Azure Data Factory and CI CD practices Familiarity with containerization and deployment tools like Docker and Kubernetes Experience with version control systems such as Git Knowledge of streaming data technologies e g Kafka Spark Streaming for real-time data processing Understanding of data governance privacy practices and compliance regulations Existing technical knowledge of modern systems software protocols and standards including SQL Server Snowflake Databricks Fabric and Power BI Experience with data visualization tools such as Power BI or Tableau Ability to translate business requirements into scalable technical solutions Strong analytical problem-solving and troubleshooting skills Excellent communication and collaboration abilities across technical and non-technical teams Detail-oriented with a strong focus on data quality consistency and reliability Comfortable working independently and in a fast-paced team-oriented environment Familiarity with Agile or Scrum methodologies is a plus Required Experience Bachelor s degree in Computer Science Software Engineering or related field 5 years of experience in data engineering or BI reporting roles with a strong back-end focus Tungsten Automation Corporation Inc is an Equal Opportunity Employer M F Disability Vets This position is located at Unit No 902 9th Floor Building No 9 Raheja Mindspace Survey No 64 TSIIC Software Units Layout H Hyderabad TG