Hadoop Bigdata

Job Title Data Engineer Location TechM Blr ITPL Years of Experience 7 10 Years Job Summary We are seeking a highly skilled Data Engineer with a strong background in Python to join our dynamic team at TechM The ideal candidate will have 7 10 years of experience in data engineering with a proven track record of designing building and maintaining scalable data pipelines and architectures You will play a crucial role in transforming raw data into actionable insights enabling data driven decision making across the organization Skills Core Python good to have PySpark Responsibilities Design develop and maintain robust data pipelines and ETL processes to support data ingestion and transformation Collaborate with data scientists analysts and other stakeholders to understand data requirements and deliver high quality data solutions Implement data models and architectures that support analytics and reporting needs Optimize data storage and retrieval processes for performance and scalability Ensure data quality and integrity through rigorous testing and validation processes Monitor and troubleshoot data pipeline performance implementing improvements as necessary Stay updated with industry trends and best practices in data engineering and related technologies Document data processes architectures and workflows for knowledge sharing and compliance Mandatory Skills Strong proficiency in Python with experience in data manipulation libraries such as Pandas and NumPy Extensive experience with SQL and relational databases e g PostgreSQL MySQL Hands on experience with data warehousing solutions and ETL tools Familiarity with big data technologies e g Hadoop Spark is a plus Experience with cloud platforms e g AWS Azure GCP and their data services Strong understanding of data modeling concepts and best practices Excellent problem solving skills and attention to detail Preferred Skills Experience with data visualization tools e g Tableau Power BI Knowledge of machine learning concepts and frameworks Familiarity with containerization technologies e g Docker Kubernetes Experience with version control systems e g Git Qualifications Bachelor s or Master s degree in Computer Science Engineering or a related field 7 10 years of experience in data engineering or a related field Proven track record of successful data projects and implementations Strong communication skills and ability to work collaboratively in a team environment If you are passionate about data engineering and possess the required skills we invite you to apply and join our innovative team at TechM Tech Mahindra represents the connected world offering innovative and customer-centric information technology experiences enabling Enterprises Associates and the Society to Rise We are a USD 4 9 billion company with 121 840 professionals across 90 countries helping over 935 global customers including Fortune 500 companies Our convergent digital design experiences innovation platforms and reusable assets connect across a number of technologies to deliver tangible business value and experiences to our stakeholders Tech Mahindra is the highest ranked Non-U S company in the Forbes Global Digital 100 list 2018 and in the Forbes Fab 50 companies in Asia 2018