Lead Big Data Developer

4 дней назад

Киев, Киев, Украина Grid Dynamics Полный рабочий день 104 000 $ - 130 878 $ в год

The primary business objective of this project is to modernize and scale the enterprise data platform by migrating the existing on-premises HDFS and Hive-based ecosystem to a cloud object storage solution.

This transition aims to reduce infrastructure maintenance overhead, improve scalability, and support advanced analytics through Apache Iceberg, which offers improved performance, versioned datasets, and native compatibility with modern data processing engines.

Responsibilities

  • Lead and mentor a team of data engineers, providing technical direction and career guidance.
  • Define the target data platform architecture for migrating from on-prem HDFS/Hive to Cloud Object Storage (e.g., AWS S3, Azure Data Lake Storage, or GCP Cloud Storage).
  • Select and integrate cloud-based compute and query engines (e.g., Spark).
  • Lead the design of ingestion, transformation, and storage patterns optimized for scalability, cost-efficiency, and performance in the cloud.
  • Define security, encryption, and compliance controls for sensitive enterprise data in the cloud.
  • Develop and own the migration roadmap, including phased transition from on-prem to cloud while minimizing business disruption.
  • Oversee data migration strategies (bulk historical loads, incremental sync, and cutover).
  • Define and enforce coding standards, CI/CD pipelines, and automated testing for data pipelines.
  • Partner with Data Architects, Cloud Engineers, and Security teams to align platform design with enterprise standards

Requirements

  • Proven experience leading data engineering teams, including distributed teams across multiple geographies and time zones.
  • Effective in managing cross-team collaboration with architects, product managers, and operations.
  • Knowledge of Scala and Python
  • Experience with Apache Spark (batch & streaming)
  • Deep knowledge of HDFS internals and migration strategies.
  • Experience with Apache Iceberg (or similar table formats like Delta Lake / Apache Hudi) for schema evolution, ACID transactions, and time travel.
  • Running Spark and/or Flink jobs on Kubernetes (e.g., Spark-on-K8s operator, Flink-on-K8s).
  • Experience with distributed blob storages like Ceph or AWS S3 and similar
  • Building ingestion, transformation, and enrichment pipelines for large-scale datasets.
  • Infrastructure-as-Code (Terraform, Helm) for provisioning data infrastructure.
  • Strong communication skills
  • Availability to join evening calls (till 21:00 EET)

Nice to have

  • Experience with Apache Flink

We offer

  • Opportunity to work on bleeding-edge projects
  • Work with a highly motivated and dedicated team
  • Competitive salary
  • Flexible schedule
  • Benefits package - medical insurance, sports
  • Corporate social events
  • Professional development opportunities
  • Well-equipped office

About Us
Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.

  • Big Data Business Analyst

    4 дней назад

    Киев, Киев, Украина KyivstarКиївстар Полный рабочий день 60 000 $ - 100 000 $ в год

    Ready to take your business analysis skills to the next level? Join the Big Data team at Kyivstar — where data meets real impact. We're looking for Business Analyst who's curious, driven, and eager to grow in a collaborative and innovative environment. You'll be working on cutting-edge AdTech solutions, helping Kyivstar build a data-powered advertising...

  • Big Data Analyst

    4 дней назад

    Киев, Киев, Украина Kyivstar Полный рабочий день 60 000 $ - 100 000 $ в год

    We are looking for talented Data Analyst with a passion for managing, analyzing and visualizing data to find actionable Insights and help improve outcomes for our business and internal customers. Responsibilities: •Deep-dive analysis of subscriber-data from large databases; •Writing and running SQL queries to retrieve data from databases; ...

  • Middle Strong/Senior developer

    4 дней назад

    Киев, Киев, Украина TechMagic Полный рабочий день 104 000 $ - 130 878 $ в год

    We are looking for an experienced developer to join a large-scale data-driven platform with millions of users.Requirements:4+ years of experience in developmentStrong expertise with Hands-on experience with gRPCSolid knowledge of SQL databases (MySQL, PostgreSQL)Experience with DockerUnderstanding of DevOps practices (CI/CD, monitoring, deployment...

  • Computer Vision Lead

    4 дней назад

    Киев, Киев, Украина Data Science UA Полный рабочий день 900 000 ₴ - 1 200 000 ₴ в год

    About us:Data Science UAis a service company with strong data science and AI expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, setting the foundation for our growth. Over the past 9 years, we have diligently fostered one of the largest Data Science & AI communities in Europe.About the role:We seek an...

  • Senior Data Science Manager

    4 дней назад

    Киев, Киев, Украина SWATX Полный рабочий день 90 000 $ - 120 000 $ в год

    SWATX is looking for a visionary and results-driven Senior Data Science Manager to join our leadership team. In this pivotal role, you will be responsible for overseeing the strategic direction and execution of data science initiatives across the organization. You will lead a talented team of data scientists, driving innovation in predictive modeling,...

  • Lead ML/Python Developer IRC269423

    4 дней назад

    Киев, Киев, Украина GlobalLogic Полный рабочий день 90 000 $ - 120 000 $ в год

    DescriptionLead App Dev – Ideal candidate has experience with Knowledge Graphs, App dev, AI and agentic.RequirementsLooking for a highly skilled and Lead ML/Python Engineer who will be responsible for designing and implementing software solutions for a ConversationalAI. Need to work closely with stakeholders, development teams, and project managers to...

  • Lead React Frontend Developer IRC274096

    4 дней назад

    Киев, Киев, Украина GlobalLogic Полный рабочий день 80 000 $ - 120 000 $ в год

    DescriptionThe client provides a reimbursement platform available for companies with mobile employees who are traveling places for their day-to-day job. They have solutions for Small and Medium Businesses, Mid-size companies and Enterprises to enable them to manage the reimbursement by streamlining and optimizing calculation process, control cost by using...

  • Data Solution Architect with GCP

    11 часов назад

    Киев, Киев, Украина EPAM Systems Полный рабочий день 104 000 $ - 130 878 $ в год

    We are looking for a Data Solution Architect with expertise in Google Cloud Platform (GCP) to join our team.In this role, you will work closely with business stakeholders to identify solution requirements, design data analytics solutions, and lead their implementation. You will also participate in company-wide Data and Big Data initiatives, stay updated on...

  • Salesforce Developer

    4 дней назад

    Киев, Киев, Украина Augment Полный рабочий день 104 000 $ - 130 878 $ в год

    Role: Freelance Salesforce DeveloperExperience: 6+ YearsLocation: RemoteJob Description:We are looking for a Salesforce Certified Developer with strong data migration experience to support our project on a freelance/contract basis.Requirements:Salesforce Certified Developer (Platform Developer I/II).6+ years of Salesforce development...

  • Senior Data Engineer

    4 дней назад

    Киев, Киев, Украина Solidgate Полный рабочий день 90 000 $ - 120 000 $ в год

    Solidgate is a payment processing and orchestration platform that helps thousands of businesses to accept payments online. We develop cutting-edge fintech solutions to facilitate seamless payment processing for merchants across 150+ countries, spanning Europe to LATAM, the USA to Asia. We are proud to be a part of the history of every company we work with -...