Software Engineer (Python/Java)

The team is responsible for the developing a data based product that use cutting-edge technologies such as big data technologies, Springboot Java microservices deployed on Kubernetes/Openshift/AKS/EKS and more. Ingesting data from Kafka, expose rest APIs, working with multiple DBs such as Scylla, Snowflake, Postgres.

• Work with other team members to improve, maintain and monitor the data ingestion domains in the Data and AI platform.

• Innovate the ingestion and analytics domains and extend the capabilities and knowledge within the team.

• Work with the architect of the domains.

• Python development specifically as Data Engineer Expert or specialist with at least 5 years of experience.

• Experience and deep knowledge of Spark, Kafka, open table, NOSQL and SQL DBs.

• Knowledge in Java, microservices and K8S.

• Databricks experience and data platform development tools.

• Monitoring tools (Prometheus and Grafana)

• Working with Copilot writing prompts to enhance efficiency during development- an advantage