Data Engineer

1 week ago

Remote, India star4rall it solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year
Job Title: DATA ENGINEER Location: Remote Employment Type: Permanent role Client: Bilge Adam(UK Based client) Work Time: 2pm-11pm Experience: 4-6years
Job Description:  The Role As a Data Engineer you'd be working with us to design, maintain, and improve various analytical and operational services and infrastructure which are critical for many other functions within the organization. These include the data lake, operational databases, data pipelines, large-scale batch and real-time data processing systems, a metadata and lineage repository, which all work in concert to provide the company with accurate, timely, and actionable metrics and insights to grow and improve our business using data. You may be collaborating with our data science team to design and implement processes to structure our data schemas and design data models, working with our product teams to integrate new data sources, or pairing with other data engineers to bring to fruition cutting-edge technologies in the data space.  Our Ideal Candidate We expect candidates to have in-depth experience in some of the following skills and technologies and be motivated to build up experience and fill any gaps in knowledge on the job. More importantly, we seek people who are highly logical, with a balance of respect for best practices and using their own critical thinking, adaptable to new situations, capable of working independently to deliver projects end-to-end, communicates well in English, collaborates effectively with teammates and stakeholders, and eager to be on a high-performing team, taking their careers to the next level with us. Highly relevant:
•       General computing concepts and expertise: Unix environments, networking, distributed and cloud computing
•       Python frameworks and tools: pip, pytest, boto3, pyspark, pylint, pandas, scikit-learn, keras
•       Agile/Lean project methodologies and rituals: Scrum, Kanban
•       Workflow scheduling and monitoring tools: Apache Airflow, Luigi, AWS Batch
•       Columnar and big data databases: Athena, Redshift, Vertica, Snowflake, Hive/Hadoop
•       Version control: git commands, branching strategies, collaboration etiquette, documentation best practices
•       General AWS or Cloud services: Glue, EMR, EC2, ELB, EFS, S3, Lambda, API Gateway, IAM, Cloudwatch, DMS
•       Container management and orchestration: Docker, Docker Swarm, ECS, EKS/Kubernetes, Mesos
•    CI / CD tools: CircleCI, Jenkins, TravisCI, Spinnaker, AWS CodePipeline . Also good to have:
•       JVM languages, frameworks and tools: Kotlin, Java, Scala / Maven, Spring, Lombok, Spark, JDK Mission Control
•       Distributed messaging and event streaming systems: Kafka, Pulsar, RabbitMQ, Google Pub/Sub
•       RDBMS and NoSQL databases: MySQL, PostgreSQL / DynamoDB, Redis, Hbase
•       Enterprise BI tools: Tableau, Qlik, Looker, Superset, PowerBI, Quicksight
•       Streaming data processing frameworks: Spark Streaming, Apache Beam, Apache Flink
•       Data science environments: AWS Sagemaker, Project Jupyter, Databricks
•       Log ingestion and monitoring: ELK stack (Elasticsearch, Logstash, Kibana), Datadog, Prometheus, Grafana
•       Metadata catalogue and lineage systems: Amundsen, Databook, Apache Atlas, Alation, uMetric
•       Data privacy and security tools and concepts: Tokenization, Hashing and encryption algorithms, Apache Ranger   

  • Operation Analyst

    2 weeks ago

    Remote, India Data Engineer Academy LLP Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Job Title: Operations AnalystLocation: Remote | Experience: 0-1 YearsType: Full-TimeNotice-Immediate JoinerAbout Us: Data Engineering Academy is an edtech startup led by FAANG data engineers. We equip aspiring data professionals with the tools, training, and support to succeed in the tech industry.About the Role:We're looking for a proactive Operations...

  • Senior Azure Data Engineer

    3 days ago

    Remote, India Data PlatformExperts Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job Description:We are looking for a skilled and motivated AI Azure Data Engineer with strong expertise in Microsoft Azure data services. The ideal candidate must have hands-on experience with Databricks or Microsoft Fabric and hold a valid certification in either. You will be responsible for designing, developing, and deploying scalable data pipelines,...

  • Subject Matter Expert Specialist

    2 days ago

    Remote, India Data Engineer Academy LLP Full time ₹ 7,20,000 - ₹ 12,00,000 per year

    We're Hiring: Subject Matter Expert (SME) – Snowflake & Databricks on AWS CloudRemote | Part Time | Flexible Timings | Pay: ₹600 – ₹1000/HourAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 10 years of experience in cloud data...

  • Senior Data Engineer

    2 weeks ago

    Remote, India AABM Cloud Data Solutions Full time ₹ 20,00,000 per year

    Senior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.Job Type: Full-timePay: From ₹2,000,000.00 per yearApplication Question(s):How many years of Python Experience do you have?How many...

  • Expert AI Data Rater

    5 days ago

    remote, India Welo Data Full time

    Expert AI Data Rater, English (India) — Shape Global Digital Ads QualityLocation: Remote – Based in India | Contract: Full-Time, Fixed-Term | Start Date: ASAPAt Welo Data, we're not just rating ads; we're actively defining the future of digital content and AI experiences. As a global leader in localization and data transformation, we operate one of the...

  • Data Engineer

    5 days ago

    remote, India Riskonnect Full time

    Data Engineer – Microsoft Fabric & Advanced Analytics Summary We are seeking a skilled Data Engineer with hands-on experience in Microsoft Fabric and advanced analytics platforms. The ideal candidate will design, optimize, and maintain data models and data pipelines to support reporting, analytics, and data science needs across the enterprise. You will...

  • Data Engineer

    1 day ago

    Remote, India TriDevSofts Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Data Engineer – DBT & RedshiftExp YearsLocation: RemoteJob SummaryWe are seeking a skilled Data Engineer with hands-on experience in DBT (Data Build Tool) and Amazon Redshift to design, build, and maintain scalable data pipelines and models. You'll collaborate with analytics and engineering teams to transform raw data into actionable insights using modern...

  • Data engineer

    6 days ago

    Remote, India INNONEXIS TECHNOLOGY PRIVATE LIMITED Full time ₹ 4,80,000 - ₹ 6,00,000 per year

    We're Hiring: Freelance Data EngineerWe are looking for a talented Freelance Data Engineer to help us design, build, and optimize scalable data pipelines and platforms. Key Responsibilities:Design, develop, and maintain ETL pipelines and workflowsWork with structured and unstructured data across multiple sourcesImplement and optimize data solutions on AWS...

  • Data Engineer

    1 week ago

    Remote, India Mig Staffing Full time ₹ 12,00,000 - ₹ 30,00,000 per year

    We are seeking a dynamic and highly skilled Data Engineer who has extensive experience building enterprise scale data platforms and lead these foundational efforts. This role demands someone who not only possesses a profound understanding of the data engineering landscape but is also at the forefront of their game. The ideal candidate will contribute...

  • Data Engineer

    2 weeks ago

    Remote, India Deltacubes Technologies Full time ₹ 13,20,000 - ₹ 14,40,000 per year

    JD(1) for Data Engineer with strong Data Vault 2.0 - Chennai basedImmediate Joiners only· Experience: 6 -8yearsWFO/WFH/ Hybrid· Strong expertise in data transformation and pipeline development (SQL, Python, DBT)· Strong expertise and experience in Data Vault 2.0 modeling framework· IDE-savvy, working with dbt CLI locally and github copilot· Build dbt...