Skip to content

Instantly share code, notes, and snippets.

@robson-koji
Last active June 27, 2023 20:27
Show Gist options
  • Save robson-koji/789fc881c82649d5837625923dbfb734 to your computer and use it in GitHub Desktop.
Save robson-koji/789fc881c82649d5837625923dbfb734 to your computer and use it in GitHub Desktop.
My Job Hunting

My Job Hunting

About Me

I am a highly committed and skilled professional with a strong track record of solving complex software engineering problems efficiently.

I like to complete simpler tasks fast, and focus on delivering high-quality solutions and attention to detail ensures that I am always able to meet project deadlines and exceed expectations.

My ability to tackle challenging problems and deliver results quickly makes me an invaluable asset to any team.

@robson-koji
Copy link
Author

robson-koji commented May 13, 2023

  1. How much experience do you have in building new and maintaining existing data store(s) that support various products? Share the details
    I have been working for the last 8 years for a major research agency in São Paulo/Brazil. I am responsible to maintain a Information System in Python/Django, backed by SQL and NonSQL datasources. The backend provides information for the front-end, for internal stackeholders, provide inforamation for charting and data analysis.

  2. Have you created/built APIs and microservices using Python/NodeJS to enable integration/migration with various business processes/systems? If so, provide details
    I consume a lot of external data from external providers and partners, from the government and private sectors, from many different formats. I also delivery information for other partners. This is all backed by Python, not NodeJS. With node, my experience is to develop a frontend in ReactJS for this same system.

  3. Have you Designed components and systems that meet high quality-bar and are maintainable for the long run? If so, provide the details
    This system is running for 8 years. We are a small team and the system is well maintaned since I applied best practices and automation as ci/cd and tools like GitLab, Jenkins, Ansible, cronjobs, etc. I have a system developed in AngularJs/Tornado for about 10 years, and the last time I heard about, it is still in production, to back a comercial team of a Series C startup in Brazil.

  4. Have you developed high performance and highly scalable systems based on the AWS stack? If so, provide the details
    I used AWS 10 years ago, in the early days of AWS. The whole infrastructure of the startup run in the cloud at that time, up to today. I left there 8 years ago. In the last year, I have been working with GCP, and I always try different approachs to balance cost and performance, using assinchronous processes in a non managed servers to reduce costs and using managed services whenever syncrhounous and durable data are required.

  5. How many years of experience do you have in the tech stack mentioned below along with self rating (1 being lowest and 10 being highest (Expert)?
    I will list experience with GCP like services, for the AWS requirements, since I do have experience with AWS and GCP (Google Cloud), as well as working with monolithic environments and on-premise systems.

  6. Python
    10 years working with Python in production environment

  7. AWS Lambda
    5 - Cloud Functions (GCP)

  8. PostgreSQL
    8 - Using Postgres for more than 10 years

  9. Node.JS
    4 - NodeJS only to back a ReactJS. But lot of javascript in my entire carreer

  10. RDS
    8 - Cloud SQL (GCP) + On-premisse Postgres + MySQL

  11. DynamoDB
    8 - Datastore/Firestore (GCP) + Elasticsearch + Apache Solr

  12. S3
    8 - S3 + Cloud Storage (GCP)

  13. API Gateways
    I was not required in my actual job, to use API Gateways, but yeah, I am aware of microservices architecture.

  14. Terraform and maintaining infrastructure as code
    I didn't work with Terraform, but with many techs of the DevOps stack, like Jenkins, Docker, Git, Ansible, GCP, AWS. In the past I used Perl a lot to automate tasks, and nowadays, Python for software development and automation too.

  15. Do you have hands-on experience with developing/deploying/monitoring containerized web applications using various AWS services
    I have been using GCP. I use AppEngine, ComputeEngine, CloudFunctions, CloudRun, CloudSQL, DataStore, with all the required steps to make it work, like security, autorization/authentication by users, service accounts etc, monitoring, logging etc.

  16. Do you have experience in working collaboratively and delivering in the Agile model?
    Yes, I like to work in a Agile team with some key roles defined, to take fast decisions and constinous delivery.

  17. Can you work full time (40 hours/week, 8 hours/day), and how soon can you start for this role (do you have a notice period)?
    I can work full time, start in two weeks.

  18. This role requires 6 hours of working in overlap with PST timezone, is this OK for you?
    It is ok for me. I am in UTC-3. So we can overlap. At the momement, in parallel with my job, I work as a SE volunteer with a team from California in the wildlife conservation field. It works fine.

  19. This would require 30 minutes to an hour interview from Turing as well as from client. are you ready to take the interviews?
    That is ok, as far as you hire me! :-)
    Just kidding. I can talk to you, I know that this is part of the process and you may select or not to proceed with me. Please feel free to contact me.

@robson-koji
Copy link
Author

robson-koji commented May 13, 2023

  1. How many years of experience do you have as a Full Stack Developer?
    I have 15 years of experience working with various programming languages and technologies, including Python, Django, Perl, Java, JavaScript, ReactJS, AngularJS, jQuery, SQL, Postgres, MySQL, Solr, ElasticSearch, Jenkins, Git, Ansible, AWS, GCP, CI/CD, Fullstack, Docker, Machine Learning, REST APIs.

  2. How many years of experience do you have in using Python for backend development?
    10 years working with Python in production environment.

  3. How many years of experience do you have working on SQL?
    15 years working with SQL in production environment.

  4. How many years of experience do you have working on GCP?
    1 year working with GCP in production environment + 1 year working in side projects.
    2 more years in AWS, in the yearly days of AWS (2010).

  5. How many years of experience do you have working on DevOps?
    5 years in a Jenkins, GitLab, Ansible, TDD, environment + 1 year in a GCP + GitHub

  6. Tell us about your experience working with web app development, what areas are your strongest, and what areas are your weakest?
    I have been working with the Internet Architecture and web applications development since the early days of the Internet, in the early 2000. Many technologies and concepts used in the early 2000 are still in use today, like n-layers application, separation of responsibilities, application server, web server, databases, backend, frontend.
    Nowadays, we have some technologies that scales best for the actual reality, like cloud managed infrastructure, assynchronous processes, NoSQL database, BigDat. At most it was all there, and I have been updating my knowledges with the new tecnologies.
    I choose to work on the backend side.

  7. What’s the most advanced thing you’ve accomplished in Front-End Development? What was challenging about it and how did you overcome that challenge?
    Do mean modern Front-End technologies, like ReactJS, AngularJS? I developed a AngularJS client for a Edtech, and a ReactJS client to consume data from Elasticsearch, in a very straight forward architecture to speed up response of a search page of scientific articles.
    I also used d3js for charting, and I updated a discontinued library that integrates d3js and ReacJS.

  8. Have you worked in a startup environment? What were you hired for, and what did you actually do? Who did you report to? How did you deal with ambiguity?
    I worked in a startup backed by BostonCapital from BankBoston in the early 2000. We developed a aggregation system, and the company was lately sold, in a divestment process. We used lots of cutting edges tecnologies at that time, technologies that proved successful and are largely used today. For example, Linux, Postgres, J2EE, Python, WebServices, ApplicationServer, Apache HTTP Server, so on and so forth.
    I worked in another startup from 2010 to 2012, in the logistics field, where I can highlight some points of my job:

  • Innovated and implemented a platform for freight quotations using Python, Django, Postgres, and AWS, resulting in an improved user experience with customized quotations based on cargo information.
  • Demonstrated creativity in building a synchronized pipeline for the commercial team's backend system, utilizing AngularJS, Python, Tornado, and Websocket, which enabled seamless communication and improved productivity.
  • Contributed to process improvement by optimizing the system's performance, enhancing its scalability, and ensuring data security.
  • Successfully delivered projects within specified timelines, ensuring quality assurance and meeting customer expectations.
  • Collaborated and communicated effectively with cross-functional teams to identify project requirements, design solutions, and troubleshoot issues.
  1. Have you been involved in building a customer-facing MVP before? What was your role? Can you describe the most challenging aspects you dealt with? What did you learn?
    I love the startup spirit and I try to bring to all my jobs the concept of developing a MVP for all systems/features to be created. I believe in the time-to-market needs to deliver fast and increment later.
    As a experienced Full Stack Developer I can bring all the knowledge needed to respond fast to the company needs and build and deliver a MVP to deploy a product to the market and to the public, and to provide a clean vision of the potential of the company's business model for investors.

  2. Can you work full time (40 hours/week, 4 hours/day), and how soon can you start for this role (do you have a notice period)?
    Yes, I can work full time and I can start as soon as you need.

  3. This role requires 4 hours of working in overlap with UTC+1:00 Europe/Paris, is this OK for you?
    I am at UTC-3. I can overlap from 11:00AM to 11:00PM UTC+1

@robson-koji
Copy link
Author

robson-koji commented May 17, 2023

  1. How much experience do you have in software development?
    I have 15 years of experience working with various programming languages and technologies, including Python, Django, Perl, Java, JavaScript, ReactJS, AngularJS, jQuery, SQL, Postgres, MySQL, Solr, ElasticSearch, Jenkins, Git, Ansible, AWS, GCP, CI/CD, Fullstack, Docker, Machine Learning, REST APIs.

  2. Have you built complex backends using Python or any other language?
    Yes, I have worked on numerous projects in the financial system, including the development of internet banking and investment banking systems.
    I have also worked on complex international projects involving institutions such as B3 (Brazilian Stock Exchange) and CME (Chicago Mercantile Exchange). In these projects, I was responsible for documenting the entire infrastructure, network, storage, database, and applications for disaster recovery purposes.
    Additionally, I have experience working with a major Funding Agency of Science and Technology in São Paulo, Brazil, where I developed a system using Python/Django, SQL, and NoSQL technologies like Apache Solr and Elasticsearch.

  3. If not Python, which was your primary language?
    Python is my primary language. We can schedule a screen sharing session for live coding.

  4. Do you have experience in the Data/ML field?
    Yes, I have experience working on both production projects and side projects related to Data/ML. Some examples include:

  • Developing a system to disambiguate research articles funded by the agency using Python Dedupe.
  • Actively training in Kaggle to improve my machine learning/deep learning skills.
  • Volunteering for a nonprofit organization in California, where we use a PyTorch-based system called Megadetector for wildlife preservation. I am involved in organizing the annotation pipeline to accelerate the process and provide visibility to the team and the public.
  1. Did Data/ML play any role during your work on the backend? If yes, how did you utilize it?
    During my work with Apache Solr over the past eight years, I developed a proof of concept (POC) analytic system for senior management at the Foundation. In this POC, I utilized Python to transform document data into the analytics system.
    Additionally, I have utilized machine learning techniques to enhance our models by developing a Python library for brute force simulation.
    Delivering models to enhance our data to, using SKLearn and Python Dedup.
    Advandced SQL skills to move data from databases to documents.
    BigQuery studies on Kaggle, using SQL APIs to handle bilion of documents.

  2. Would you say you are a product-focused engineer?
    Yes, I consider myself a product-focused engineer. I have collaborated with stakeholders at various levels and always strive to deliver products that align with the requirements of product owners and senior management. I also have a strong focus on providing valuable insights and information through robust backend features, ensuring the best possible user experience.

  3. Do you have experience with Entity Classification, Data Extraction, Knowledge Graph Creation, and Prompt Engineering?
    I have experience in Entity Classification and Data Extraction through the following projects:

  • Utilizing Python Dedupe for disambiguating researchers in scientific articles.
  • Working on animal sighting classification in natural environments.
    While I have not directly worked with Knowledge Graph Creation and Prompt Engineering, I have experience working with search engine systems that leverage data extraction, entity recognition, and relationship extraction. I have also combined data from various sources, including structured databases, unstructured text documents, and external knowledge bases, to develop a digital library for a major foundation in São Paulo, Brazil.
  1. Do you have exposure to one of the tools in your work: GPT-4, LangChain, Pinecone?
    I have not had direct experience with tools such as GPT-4, LangChain, or Pinecone in my previous work. However, I am highly familiar with OpenAI Copilot and now CopilotChat, and I use them extensively on a daily basis for programming tasks. I have a deep understanding of the underlying technology and can effectively leverage it to develop systems backed by large language models (LLMs).

  2. Are you comfortable working 4 hours overlapping with the PST timezone from 9 am - 1 pm PST?
    Yes, I am at UTC-3. I can overlap from 9:00AM to 1:00PM PST

  3. Can you work full time (40 hours/week, 8 hours/day), and how soon can you start for this role (do you have a notice period)?
    Yes, I can work full time and I can start as soon as you need.

@robson-koji
Copy link
Author

  1. Do you have experience Working as a Data engineer?
    Yes, a significant portion of my Software Engineer career has been focused on Data Engineering.

  2. Please share a few words about your recent responsibilities in these roles.
    Develop, construct, and maintain systems and infrastructure to manage and process large volumes of data:

  • Collect data from web services of external partners (data providers, government institutions, universities).
  • Transform and normalize data to meet our needs.
  • Load data into our SQL (Postgres, MySQL) and NoSQL databases (Solr and Elasticsearch).
  • Develop a front-end for data analytics.
  1. Since when or how long have you been working as a Data Engineer? Please specify the years of your Data engineering experience.
    Since 2015 in production environment.

  2. Do you have experience with Python? If yes, please specify the number of years of Python experience.
    10+ years in production environment.

  3. Do you have experience in DevOps? If yes, Please specify the years of work experience.
    5+ years.
    Experience with Jenkins, Git, SVN, Mercurial, GitLab, Ansible, Docker, GCP, Elasticsearch, Jira, Confluence, Trello, AWS.

  4. Do you have hands-on experience with SQL? If you do, please specify the years of work experience.
    Yes, I have over 10 years of hands-on experience with SQL. I am proficient in SQL syntax, database design and modeling, and have knowledge of advanced SQL features such as window functions, common table expressions (CTEs), and stored procedures.

  5. Do you have experience working as a Lead Data engineer? If yes, please specify your years of experience and your Role in a few words.
    As a Software Engineer, I have experience in a lead role where I have taken on responsibilities such as:

  • Identifying and resolving technical challenges and issues during the development process.
  • Facilitating effective communication within the team and with other stakeholders.
  • Project planning, defining technical requirements, estimating effort, and creating development timelines.
  • Coordinating with stakeholders, including product managers and other teams, to ensure alignment and successful project execution.
  1. Do you have experience maintaining libraries for data processing and management? Please specify
    Yes, I have more than 10 years of experience in developing and maintaining systems for internal and external stakeholders for data consumption and analysis. Some of the technologies I have used include:
  • AWS/GCP (cloud platforms)
  • Python/Django (programming language and web framework)
  • Apache Solr/Elasticsearch (search and indexing libraries)
  • Frontend libraries such as React/Angular
  • SQL/BigQuery (database management systems)
  • Machine Learning/SciKit Learn (data analysis and machine learning libraries)

9: Provide oversight for the development and maintenance of data pipelines and databases. ? Please Specify
As part of my role, I have provided oversight for the development and maintenance of data pipelines and databases for various teams and stakeholders, including commercial teams, research teams, senior management, and government entities. This involved:

  • Collaborating with different teams to understand their specific data requirements and pipeline needs.
  • Designing and implementing scalable and efficient data pipelines tailored to each team's needs.
  • Ensuring data integrity, quality, and reliability throughout the pipeline.
  • Monitoring and troubleshooting pipeline issues to minimize downtime and optimize performance.
  1. Deploy AI algorithms into data platforms to run predictive analysis.. Please Specify
    I have been involved in a project where we developed a machine learning system to identify authors of scientific articles and match them with researchers within our company. This involved deploying the AI algorithms into our data platforms to perform predictive analysis. The system utilized natural language processing and entity recognition techniques to extract author information from articles, and then applied matching algorithms to find suitable matches with our internal researchers.

11 This is a full-time opportunity, 8 hours a day, with immediate joining; are you fine with it?
Yes

  1. Do you mind overlapping 4 hours of CET TIME ZONE?
    I am at UTC-3. I can overlap 4 hours a day with no problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment