You are viewing a preview of this job. Log in or register to view more details about this job.

Data Engineer

Roles and Responsibilities
  • Identify valuable data sources and automate collection processes.
  • Undertake to preprocess of structured and unstructured data.
  • Technical expertise with data models, data mining, and segmentation techniques
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
  • Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Designs data integrations and data quality framework.
  • Develop processes and tools to monitor and analyze model performance and data accuracy.
  • Develop custom data models and algorithms to apply to data sets.
  • Use predictive modeling to increase and optimize customer experiences, revenue generation, ad targeting and other business outcomes.
Experience & Qualification Requisite
  • Minimum 3 years of Experience working as a data engineer.
  • The candidate should hold a bachelor’s degree in Computer Engineering or Computer Science from tier-1 colleges(IITs,NITs,IIITs)
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Experience with big data tools: Hadoop, Spark, Kafka, etc.
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift
  • Strong problem-solving skills with an emphasis on product development.
  • A good hands-on experience in feature engineering and dataset preparation is required.
  • Proficient with Python Programming with 2 years of experience.
  • Experience with stream-processing systems: Storm, Spark-Streaming, etc.
  • Expert in relational databases like SQL and NoSQL databases like MongoDB.