Arcgate - Data Engineer - Python/SQL

3 weeks ago


Udaipur India Arcgate Full time

Job Description Description About : Arcgate is a dynamic and rapidly growing team of 2500+ professionals passionate about data and technology. Responsibilities We deliver cutting-edge solutions to some of the worlds most innovative startups to market leaders across application development, quality engineering, AI data preparation, data enrichment, search relevance, and content: - Design, build, and optimize Python based data pipelines that handle large, complex, and messy datasets efficiently. - Develop and manage scalable data infrastructures, including databases and data warehouses such as Snowflake, Azure Data Factory etc ensuring reliability and performance. - Build, maintain, and optimize CDC processes that integrate data from multiple sources into the data warehouse. - Collaborate closely with data scientists, analysts, and operations teams to gather requirements and deliver high-quality data solutions. - Perform data quality checks, validation, and verification to ensure data integrity and consistency. - Support and optimize data flows, ingestion, transformation, and publishing across various systems. - Work with AWS infrastructure (ECS, RDS, S3), manage deployments using Docker, and package services into containers. - Use tools like Prefect, Dagster and dbt to orchestrate and transform data workflows. - Implement CI/CD pipelines using Harness and GitHub Actions. - Monitor system health and performance using DataDog. - Manage infrastructure orchestration with Terraform and Terragrunt. - Stay current with industry trends, emerging tools, and best practices in data engineering. - Coach and mentor junior team members, promoting best practices and skill development. - Contribute across diverse projects, demonstrating flexibility Bachelors degree in Computer Science, Engineering, Mathematics, Physics, or a related field. - 5+ years of demonstrable experience building reliable, scalable data pipelines in production environments. - Strong experience with Python, SQL programming, and data architecture. - Hands-on experience with data modeling in Data Lake or Data Warehouse environments (Snowflake preferred). - Familiarity with Prefect, Dagster, dbt, and ETL/ELT pipeline frameworks. - Experience with AWS services (ECS, RDS, S3) and containerization using Docker. - Knowledge of TypeScript, React, Node.js is a plus for collaborating on the application platform. - Strong command of GitHub for source control and Jira for change management. - Strong analytical and problem-solving skills, with a hands-on mindset for wrangling data and solving complex challenges. - Excellent communication and collaboration skills; ability to work effectively with crossfunctional teams. - A proactive, start-up mindset, adaptable, ambitious, responsible, and ready to contribute wherever needed. - Passion for delivering high-quality solutions with meticulous attention to detail. - Enjoy working in an inclusive, respectful, and highly collaborative environment where every voice matters. Benefits - Competitive salary package. - Opportunities for growth, learning, and professional development. - Dynamic, collaborative, and innovation-driven work culture (ref:hirist.tech)



  • Udaipur, India Arcgate Full time

    Description :About :Arcgate is a dynamic and rapidly growing team of 2500+ professionals passionate about data and technology.We deliver cutting-edge solutions to some of the worlds most innovative startups to market leaders across application development, quality engineering, AI data preparation, data enrichment, search relevance, and...


  • Udaipur, India Arcgate Full time

    Description :- Form a strong understanding of the data landscape, domain and workflows for your business area, customers, and products- Coordinate the regular delivery of a curated data product, closely collaborating with colleagues across disciplines and departments- Define and design measures of data quality, taking responsibility for the ownership of data...

  • Accounts Assistant

    5 days ago


    Udaipur, India Arcgate Full time

    Arcgate is a fast-growing team of 2500+ passionate individuals dedicated to solving data and technology problems for our clients. We specialize in providing innovative solutions to some of the most disruptive startups worldwide, assisting them with AI data preparation, Accounting Tasks, Data Enrichment, Search Relevance, Content Moderation, Application...


  • Udaipur, India Arcgate Full time

    Key Responsibilities:Market & Industry Research:- Conduct qualitative and quantitative research on industry trends, competitors, customer behavior, and emerging markets.- Collect and analyze primary and secondary data from reliable sources (databases, industry reports, surveys, financials).- Perform competitor benchmarking and SWOT analysis to identify...


  • Udaipur, India Arcgate Full time

    Job Description :- Strong MERN (Mongo DB , Express, React, Node JS) full stack experience using Typescript.- Experience in participating in code reviews.- Demonstrate understanding of SOLID principles.- Demonstrate understanding of TDD or BDD.- Good knowledge and experience of writing good unit tests.- Some experience of implementation design using cloud.-...


  • Udaipur, India Arcgate Full time

    3+ years of experience as a Python Developer. - Expertise in at least one popular Python framework (like Django, Flask or Pyramid). - Knowledge of Object Relational Mapping (ORM). - Best practices on Cloud Platform. - Familiarity with front-end technologies (like JavaScript and HTML5). - In-depth knowledge of code versioning tools, for instance, Git. - Good...

  • Python SQL Engineer

    2 days ago


    India Virtusa Full time

    Job Description Job Description Analyze complex datasets to derive actionable insights and support business decisions. Model data solutions for high performance and reliability. Work extensively with Python for data processing and automation. Develop and optimize SQL queries for Postgres, SQLServer, or MySQL databases. Ensure data integrity, security, and...


  • Chennai, India Eucloid Data Solutions Full time

    Job Description Job Description : is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and...


  • Hyderabad, India Tata Consultancy Services Full time

    Job Description TCS has been a great pioneer in feeding the fire of young techies like you. We are global leaders in the technology arena and there's nothing that can stop us from growing together. TCS Hiring for skill Data Engineer (Python, Databricks, SQL). Role: Data Engineer (Python Pyspark Data bricks) Required Technical Skill Set: Python Pyspark Data...


  • india, IN HRM Counsel Full time

    We are looking for an experienced SQL or Python Developer to join our engineering team and help us create dynamic software applications for our clients. In this role, you will be responsible for writing and testing scalable code, developing back-end components, and integrating user-facing elements in collaboration with front-end developers. To be successful...