Eucloid - Senior Data Engineer - Python/SQL/ETL
16 hours ago
Job Description : is looking for a
Senior Data Engineer
to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of different components. Candidate will also involve in projects like integrating data from various sources, managing big data pipelines that are easily accessible with optimized performance of overall ecosystem.
The ideal candidate is an experienced data wrangler who will support our software developers, database architects and data analysts on business initiatives. You must be self-directed and comfortable supporting the data needs of cross-functional teams, systems, and technical solution.
Responsibilities
- Responsible for the design, deployment, configuration, and operations for a multi-node big data cluster. This includes working with open source and/or commercial stacks to support the full SDLC. Resource will work to deploy, manage, and maintain development, test and production environments for the big data platform.
- Develop scripts to automate and streamline operations and configurations in the infrastructure
- Specify, design, build, and support BI solutions by working closely with datalake team
- Create dashboards and KPIs to show the business performance to management.
- Design and maintain data models used for reporting and analytics
- Work to identify infrastructure needs and providing support to developers and business user
- Research performance issues; Optimize platform for performance
- Troubleshoot and resolve issues in all operational environments
- Work with a cross functional team delivering software deployments
- Forward thinking by continuously adopting new ideas and technologies to solve business problems
- Own the design and development of automated solutions for recurring reporting and in-depth analysis.
- A problem solver and critical thinker.
Skills And Qualifications Skills Needed
- Strong Experience in Data lake Spark, distributed file system, Yarn, Cloud services (preferably GCP / AWS).
- Strong Experience in SQL tools Vertica, Dremio product or any big data SQL
- Scripting Knowledge Shell, python
- Experience with ETL and OLAP concepts in building highly scalable data pipelines
- Exposure to any Visualization systems is a plus (like Apache Superset, Tableau)
- Experience with Agile, data structures, data analysis and wrangling tools and technologies.
- Familiar with version control and relational databases.
- Strong Experience in monitoring, debugging and troubleshooting of services.
- Experience in providing on-call support.
Basic Qualifications
- Bachelors / Masters Degree in Computer or related field in a reputed institution
- 4-8 years of professional experience in software with most of them from a product company
Preferred Qualifications
- Proficient in one or more technologies like :
- AWS, EMR
- Hadoop , Spark
- SQL
- Python
- Data Structures
- Experience with working in Linux based environment
- Good communication and design skills
Location : Chennai (Work from office)
Eucloid offers a high growth path along with great compensation, which is among the best in the industry. Please reach out to if you want to apply.
)
-
Lead Data Engineer
4 days ago
Chennai, Tamil Nadu, India Eucloid Data Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearEucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support the development of data infrastructure for our clients by participating in activities that may include starting from upstream and downstream technology selection to designing and building different components....
-
Senior Data Consultant
7 days ago
Chennai, Tamil Nadu, India Eucloid Data Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per yearWe are looking for a high-energy individual for the role of Senior Data Consultant at Eucloid. The candidate will collaborate with client stakeholders on multiple projects in the eCommerce team.The candidate is expected to lead following work-streams:• Drive client meetings with data-driven insights and observations on key website/app metricsfor Upper...
-
Data Engineer
2 days ago
Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per yearWe are seeking a Senior Data Engineer with10+ yearsof experience to join our team.Required Qualifications10+ years of experience in data engineering or similar role.Hands on experience in snowflake, SSIS, Python ( including NumPy and Pandas) is mandatory.Expertise in SQL and any cloud environment (AWS & Azure, etc.) is mandatory.Proficiency in mordern BI...
-
Data Engineer+SQL+Python
4 days ago
Chennai, Tamil Nadu, India Saama Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per yearType: Full-timeExperience Level: 5+ (relevant)About the RoleWe are looking for a talented Snowflake Developer to design, develop, and maintain efficient data storage andretrieval solutions within the Snowflake platform. The ideal candidate will have a deep understanding of datawarehousing concepts, strong SQL skills, and experience in implementing. Snowflake...
-
Python & SSIS Data Engineer
1 week ago
Chennai, Tamil Nadu, India AABM Cloud Data Solutions Full time ₹ 10,00,000 - ₹ 42,00,000 per yearMANDATORY PREVIOUS WORK EXPERIENCE IN SSIS AND PYTHON. (Candidates without this experience in the past will NOT be considered for this role)JOB RESPONSIBILITIES5+ years previous work experience as a Data Engineer.Design and build data pipelines using SSIS, ADF, Talend, Informatica, Data Stage, or Ab Initio to move and transform data reliably.Manage and...
-
Data Engineer
15 hours ago
Chennai, Tamil Nadu, India Intelizign Lifecycle Services Full time ₹ 5,00,000 - ₹ 15,00,000 per yearJob Title: Junior Data EngineerExperience: 13 YearsLocation: ChennaiJob Summary:We are looking for a passionate and detail-oriented Junior Data Engineer to join our data team. The ideal candidate should have hands-on experience with ETL processes, SQL-based data transformations, and Python scripting for data processing. You will work closely with senior...
-
Python Data Engineer
20 hours ago
Chennai, Tamil Nadu, India Virtusa Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a Data Engineer with 5 to 7 years of experience, possessing strong skills in Python, AWS, SQL, and experience working with any major database. The ideal candidate should demonstrate a solid understanding of development best practices, including peer code reviews and unit testing. A strong grasp of fundamental data modeling concepts such as...
-
ETL Testing
2 weeks ago
Chennai, Tamil Nadu, India Virtusa Referral Program Full time ₹ 5,00,000 - ₹ 15,00,000 per yearDesign and execute test plans for ETL processes, ensuring data accuracy, completeness, and integrity.Develop automated test scripts using Python or R for data validation and reconciliation.Perform source-to-target data verification, transformation logic testing, and regression testing.Collaborate with data engineers and analysts to understand business...
-
ETL Support Engineer
4 days ago
Chennai, Tamil Nadu, India Work Fox Solutions Full time ₹ 12,00,000 - ₹ 18,00,000 per yearETL Support Engineer:Location: ChennaiExperience : 2 - 5 YearsCTC - 12 LPA - 18 LPAMaintain ETL pipelines using Databricks and PySpark to extract, transform, and load data from various sources.Troubleshoot and resolve issues related to data transformations or loading processes in Databricks.Develop and maintain documentation for ETL processes,...
-
ETL Testing
2 weeks ago
Chennai, Tamil Nadu, India Virtusa Full time ₹ 5,00,000 - ₹ 15,00,000 per yearDesign and execute test plans for ETL processes, ensuring data accuracy, completeness, and integrity.Develop automated test scripts using Python or R for data validation and reconciliation.Perform source-to-target data verification, transformation logic testing, and regression testing.Collaborate with data engineers and analysts to understand business...