Data Engineer

2 weeks ago


Greater Delhi Area, India Cynosure Corporate Solutions Full time

Data Engineer



Office Location: Delhi (Work from Office)



Job Type: Full-time



Experience: 5+ Years



Job Description:



We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To succeed in this position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of machine learning methods.



Job Requirements:



Participate in the customers system design meetings and collect the functional/technical requirements.



Build up data pipelines for consumption by the data science team.



Skillful in ETL process and tools.



Clear understanding and experience with Python and PySpark or Spark and SCALA, with HIVE, Airflow, Impala, and Hadoop and RDBMS architecture.



Experience in writing Python programs and SQL queries.



Experience in SQL Query tuning.



Experienced in Shell Scripting (Unix/Linux).



Build and maintain data pipelines in Spark/Pyspark with SQL and Python or SCALA.



Knowledge of Cloud Azure technologies is additional.



Good to have knowledge of Kubernetes, CI/CD concepts, Apache Kafka



Suggest and implement best practices in data integration.



Guide the QA team in defining system integration tests as needed.



Split the planned deliverables into tasks and assign them to the team.



Needs to Maintain/Deploy the ETL code and follow the Agile methodology



Needs to work on optimization wherever applicable.



Good oral, written and presentation skills.



Preferred Qualifications:



Degree in Computer Science, IT, or a similar field; a Masters is a plus



Hands-on experience with Python and Pyspark



Hands-on experience with Spark and SCALA.



Great numerical and analytical skills.



Working knowledge of cloud platforms such as MS Azure,



Technical expertise in data models, data mining, and segmentation techniques


  • Operations Specialist

    2 weeks ago


    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    2 weeks ago


    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Data Engineer

    2 weeks ago


    Greater Delhi Area, India Cynosure Corporate Solutions Full time

    Data EngineerOffice Location: Delhi (Work from Office)Job Type: Full-timeExperience: 3+ YearsJob Description:We are seeking Data Engineers to join our team. Your main task will be to transform raw data into efficient data systems. This involves creating algorithms, performing statistical analysis, and ensuring that data systems are in line with business...

  • Data Engineer

    4 weeks ago


    Greater Delhi Area, India Cynosure Corporate Solutions Full time

    Data Engineer Office Location: Delhi (Work from Office)   Job Type: Full-time   Experience: 3+ Years   Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for...

  • Data Engineer

    1 month ago


    Greater Delhi Area, India Cynosure Corporate Solutions Full time

    Data EngineerOffice Location: Delhi (Work from Office)  Job Type: Full-time  Experience: 3+ Years  Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for...

  • Data Engineer

    4 weeks ago


    Greater Delhi Area, India Cynosure Corporate Solutions Full time

    Data EngineerOffice Location: Delhi (Work from Office)  Job Type: Full-time  Experience: 3+ Years  Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for...

  • Data Engineer

    2 weeks ago


    Greater Delhi Area, India Cynosure Corporate Solutions Full time

    Data EngineerOffice Location: Delhi (Work from Office)Job Type: Full-time Experience: 5+ YearsJob Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by...

  • Data Engineer

    1 month ago


    Greater Bengaluru Area, India Genpact Full time

    Inviting applications for the role of Principal Consultant-Senior Data EngineerInclude optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency where applicable, maintaining and improving data security, proactive alerting, and monitoring for data pipelines, and automating repetitive data-oriented...

  • Data Engineer

    2 weeks ago


    Greater Bengaluru Area, India Tekgence Inc Full time

    Role : Data EngineerExp : 5 to 10 YrsLocation : PAN IndiaJD:Primaryskill: ETL, ADF, Databricks, SQL databases, Power BI, Data Migration experience, SQL, Salesforce Mulesoft tooling,Key Responsibilities· Execute data- and document migration (ETL) from 4 legacy systems to new, futureproof Sitetracker application· Build & Test API’s between Sitetracker and...


  • Greater Bengaluru Area, India Target Full time

    We are excited to announce that we are conducting a shortlisted interview drive for the position of Data Engineer/Sr. Data Engineer on Saturday, 22nd June. We are looking for talented and experienced professionals to join our team. If you are interested in this opportunity, please share your updated resume along with the following details to...

  • Data Engineer

    2 weeks ago


    Greater Bengaluru Area, India Ciber Global Full time

    Data Engineer5-10 yrsADFData BricksPythonSQL

  • Data Engineer

    2 weeks ago


    Greater Bengaluru Area, India Ciber Global Full time

    Data Engineer5-10 yrsADFData BricksPythonSQL


  • Delhi, Delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...

  • Lead Data Engineering

    4 weeks ago


    Greater Bengaluru Area, India Apex Systems Full time

    Location: Bangalore and Chennai Over 8 years of experience in Data Engineering leading the design, development and implementation of data pipelines, ETL processes and data models Lead and mentor a team of data engineers, fostering continuous learning and professional development in data technologies. Proficiency in Data Engineering, Data Warehousing, Data...

  • Lead Data Engineering

    4 weeks ago


    Greater Bengaluru Area, India Apex Systems Full time

    Location: Bangalore and ChennaiOver 8 years of experience in Data Engineering leading the design, development and implementation of data pipelines, ETL processes and data modelsLead and mentor a team of data engineers, fostering continuous learning and professional development in data technologies.Proficiency in Data Engineering, Data Warehousing, Data...


  • Greater Bengaluru Area, India Tech Mahindra Full time

    Hiring for Associate Data Engineer. Experience: 2 yrs -4 yrsJob Location: Bangalore & Pune & HyderabadMust Have Skills:2 yrs, of Strong expertise in Python for data engineering tasks (ETL/ELT).2 yrs, of Strong expertise in PySpark for Data processing and transformation2 yrs, of Experience with big data tools is desirable: Spark, Spark-Streaming, Kafka,...

  • Data Engineer

    2 weeks ago


    Greater Chennai Area, India Cynosure Corporate Solutions Full time

    Lead /Principle Data Engineer:Experience: 7+ yearsLocation: ChennaiResponsibilities:Designing and implementing data pipelines to collect, clean, and transform data from various sourcesBuilding and maintaining data storage and processing systems, such as databases, data warehouses, and data lakesEnsuring data is properly secured and protectedDeveloping and...

  • Data Engineer

    2 weeks ago


    Greater Chennai Area, India Cynosure Corporate Solutions Full time

    Lead /Principle Data Engineer: Experience: 7+ years Location: Chennai Responsibilities: Designing and implementing data pipelines to collect, clean, and transform data from various sources Building and maintaining data storage and processing systems, such as databases, data warehouses, and data lakes Ensuring data is properly secured and protected Developing...


  • Greater Bengaluru Area, India Tech Mahindra Full time

    Hiring for Associate Data Engineer. Experience: 2 yrs -4 yrsJob Location: Bangalore & Pune & HyderabadMust Have Skills:2 yrs, of Strong expertise in Python for data engineering tasks (ETL/ELT).2 yrs, of Strong expertise in PySpark for Data processing and transformation2 yrs, of Experience with big data tools is desirable: Spark, Spark-Streaming, Kafka,...


  • Greater Bengaluru Area, India Tech Mahindra Full time

    Hiring for Associate Data Engineer. Experience: 2 yrs -4 yrs Job Location: Bangalore & Pune & Hyderabad Must Have Skills: 2 yrs, of Strong expertise in Python for data engineering tasks (ETL/ELT). 2 yrs, of Strong expertise in PySpark for Data processing and transformation 2 yrs, of Experience with big data tools is desirable: Spark, Spark-Streaming,...