ArabyAds - Data Engineer - Python Programming

4 weeks ago

Gurgaon, Haryana, India Araby Ads Full time

Responsibilities :


- Design, Develop, Maintain and own data engineering projects built from requirements by different stakeholders, including but not limited to product teams, data scientists, data analysts and BI.

- Fulfill any requirement related to data pipelines, data warehouses and databases required by the application.

- Create ingestion pipelines to collect data from different sources and push to targets.

- Design and Create SQL, tables, procedures, functions etc.

- Operate and Maintain existing Hadoop Cluster.

- Write Spark Tasks/Applications mainly in Python/Java

- Evaluate, test and update data applications according to changing requirements.

- Monitor and report data systems health and security.

- Support internal teams to use our systems, troubleshoot & identify issues, and resolve them.

- Follow best coding practices and participate in the code review process.

- Use efficiently the development environment, compiling tools, version control and bug

tracking systems for all Competencies :


Must Have :

- 3 - 5years of experience in Data Engineering.

- Good Knowledge/Experience in Python/Java, C# and .NET core.

- Good Knowledge/Experience Hadoop Stack, Oozie, Spark, Kafka

- Hands-on in writing SQL queries, Stored Procedures and Database code

- Good Knowledge with concepts, design and mechanics of traditional databases, data

warehouses and data lakes

- Good Knowledge with ETL, ELT, Transformation, Processing, Computation etc.

- Experience with relational databases such as MySQL, PostgreSQL, MariaDB.

- Good Knowledge/Experience with Git, CI/CD, and writing unit tests.

- Good Knowledge/Experience working on an agile development project.

- Good Knowledge/Experience with Jira and the Atlassian tool suite.

- Good Knowledge/Experience in Linux Shell to Have :


- Experience with NoSQL databases such as Aerospike, DynamoDB, Redis, Elasticsearch, Cassandra, MongoDB

- Good knowledge of Snowflake databases, schemas, tables, procedures, functions, views, stages, pipes etc.

- Knowledge on one of the ETL tools

- Experience with performance and scalability issues.


Non Technical Competencies :


- Good English and communication skills.

- Positive and 'can do' attitude.

- Able to work independently as well as in a team.

- Able to take up challenges and come up with innovative solutions.

- We highly appreciate self-starters, initiators and contributors.

(ref:hirist.tech)

  • Python data engineering and programming

    3 days ago

    Gurgaon, Haryana, India Talent Worx Full time ₹ 2,00,000 - ₹ 2,60,000 per year

    Our client in India is a professional services firm. Our professionals leverage the global network of firms.providing detailed knowledge of local laws, regulations, markets, and competition. Our client has officesacross India in Ahmedabad, Bengaluru, Chandigarh, Chennai, Gurugram, Hyderabad, Jaipur, Kochi,Kolkata, Mumbai, Noida, Pune, Vadodara, and...

  • Python Developer with Pyspark

    3 days ago

    Gurgaon, Haryana, India Programming Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    Python DeveloperGurugram5+ YearsBudget- 12 lpaProfessional & Technical Skills:Must To Have Skills: Proficiency in Python (Programming Language)Good To Have Skills: Experience with PySpark- Strong understanding of software development principlesExperience in designing and implementing scalable applicationsKnowledge of database management systemsAbility to...

  • Data Engineer- Python and LLM

    21 hours ago

    Gurgaon, Haryana, India Acuity Knowledge Partners Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We're seeking a skilled Software Engineer with expertise in Python and it would be nice to have experience of working on Large Language Models (LLM) to join our team.Essential skillsMinimum of a bachelor's degree in a technical or quantitative field with strong academic backgroundDemonstrated ability to implement data engineering pipelines and real-time...

  • QA (Python + Jmeter)

    3 days ago

    Gurgaon, Haryana, India Programming Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company Description empowers global enterprises with next-gen digital solutions that enhance agility, efficiency, and impact. With over 22 years of excellence, we have successfully executed 1000+ projects across diverse industries including Healthcare, Automotive, Finance, Retail, and E-learning. Our team of 2200+ tech experts operates from delivery hubs in...

  • Python Data Engineer

    5 days ago

    Gurgaon, Haryana, India Infosys Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Educational RequirementsBachelor of EngineeringService LineData & Analytics UnitResponsibilitiesA day in the life of an Infoscion- As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction.- You will understand requirements, create and review...

  • Senior Data Engineer(Python, AWS)

    4 weeks ago

    Gurgaon, Haryana, India S&P Global Market Intelligence Full time

    Job DescriptionResponsibilities- Design, develop, and maintain scalable ETL/ELT pipelines.- Optimize and automate data ingestion, transformation, and storage processes.- Work with structured and unstructured data sources, ensuring data quality and consistency.- Develop and maintain data models, warehouses, and databases.- Collaborate with cross-functional...

  • Python Engineer

    4 weeks ago

    Gurgaon, Haryana, India True Talents Full time

    Job Title : Python - AI/ML EngineerLocation : Onsite - Gurugram, HaryanaExperience Required : 58 YearsEmployment Type : Full-Time (Payroll)Duration : Long-TermJob Summary :We are seeking a passionate and skilled Python AI/ML Engineer to join our team in Gurugram. The ideal candidate will have strong expertise in building and productionizing AI/ML...

  • Freecharge - Data Engineer - Spark/Python

    3 days ago

    Gurgaon, Haryana, India Freecharge Payment Technologies Pvt Ltd Full time ₹ 8,00,000 - ₹ 20,00,000 per year

    Job Title : Engineering (Data Engineering)Location : GurgaonExperience Required : 1 YearsEmployment Type : Full-Time Department : Data & AnalyticsAbout the Role : We are looking for a motivated Data Engineer to contribute to the design and development of scalable data frameworks and solutions. The role involves working with big data technologies like...

  • Data Engineer

    5 days ago

    Gurgaon, Haryana, India Acuity Knowledge Partners Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job PurposeWe're seeking a skilled Data Engineer with expertise in C++, Python and it would be nice to have experience of working on Large Language Models (LLM) to join our teamEssential SkillsDesired Skills and ExperienceMinimum of a bachelor's degree in a technical or quantitative field with strong academic backgroundDemonstrated ability to implement data...

  • Python Developer

    1 week ago

    Gurgaon, Haryana, India Digital Business People Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Title:Python Developer (Automation & API)Experience:3–5 years      Location:Offshore (Remote / India) (Ciena)Role Overview:We are seeking Python Developers with strong programming and API integration skills to support automation initiatives. Selected engineers will also get the opportunity to be trained and upskilled in Data Engineering and...