PyCon SG
PyCon SG
  • 105
  • 208 874
Scaling product support with Python at WhatsApp - PyCon SG 2019
Speaker: Mengyi Yuan, Solutions Engineer, Facebook
How do you effectively support a User-Installed Software when the software could be installed in various environments that you have no control of? This talk will share how CLI tools can be built to solve this problem, how the industry has done it over the years, how we did it at WhatsApp with great success, why we chose Python, and inspire the audience to build tools to solve similar real world problems.
About the speaker:
As a Solutions Engineer at Facebook, my job is to help solve business problems by building products. One recent example is a CLI tool built in Python to help scale product support. I am a Python beginner and always learning.
Event Page: pycon.sg/
Produced by Engineers.SG
มุมมอง: 319

วีดีโอ

How to build stream data pipeline with Apache Kafka and Spark Structured Streaming - PyCon SG 2019
มุมมอง 8K5 ปีที่แล้ว
Speaker: Takanori Aoki, Data Scientist, HOOQ Objective: Main purpose of this session is to help audience be familiar with how to develop stream data processing application by Apache Kafka and Spark Structured Streaming in order to encourage them to start playing with these technologies. Description: In Big Data era, massive amount of data is generated at high speed by various types of devices. ...
Value Investing using Python and Panda - PyCon SG 2019
มุมมอง 2.5K5 ปีที่แล้ว
Speaker: Christianto, Engineer This talk will demonstrate how to marry Python and Pandas skills with domain knowledge on value investing. In this talk we will try to find a good and healthy companies to invest in the long term, instead of doing speculation and making decision based on rumors. I will explain basic financial analysis, and then how to automate it with Python and Pandas. About the ...
Transfer Learning in Natural Language Processing (NLP) - PyCon SG 2019
มุมมอง 1.2K5 ปีที่แล้ว
Speaker: Liling Tan, Research Scientist The 'transfer learning' hype has transcended from the computer vision domain to natural language processing. This is made ever popular by the wave of language models, named after 'sesame street', ELMO, BERT, ERNIE, OSCAR, etc. This talk will cover the (i) basic understanding of language modeling, (ii) glossing over state-of-art neural net architectures fo...
Koalas: Pandas API on Apache Spark - PyCon SG 2019
มุมมอง 7345 ปีที่แล้ว
Speaker: Ben Sadeghi, Solutions Architect, Databricks Pandas is the de facto standard (single-node) DataFrame implementation in Python, while Spark is the de facto standard for big data processing. With the recently open-sourced Koalas package, you can be immediately productive with Spark, with no learning curve, if you are already familiar with pandas, and have a single codebase that works bot...
Converting a Static Map image to an Interactive Floorplan - PyCon SG 2019
มุมมอง 1.8K5 ปีที่แล้ว
Speakers: - Chinab Chugh, CTO, Jublia - Fahmi Fauzi, Team Lead, Jublia Attending an event is fun until you get lost between exhibitor booths and are unable to find your way around. In my work, we have worked with over 1500 B2B Events and we generally see the use of static floorplans (images or PDFs being the most common). The reason behind this is building Interactive Floorplans can be a time-c...
Building an interactive training environment using JupyterHub - PyCon SG 2019
มุมมอง 1.2K5 ปีที่แล้ว
Speaker: Graham Dumpleton, Developer Advocate, OpenShift JupyterHub is used to run and manage Jupyter notebook instances for multiple users at the same time. Did you know though that you can use JupyterHub to spawn applications other than Jupyter notebooks? Come see how JupyterHub was used to create a multi user interactive training environment. In this talk you will learn what JupyterHub is an...
When Uncertainty Matters: Stochastic Programming for Inventory Model with Python - PyCon SG 2019
มุมมอง 4.9K5 ปีที่แล้ว
Speaker: Novia Listiyani, Data Scientist Difference between selling price and cost price really matters - especially in retail industry. In fact, the ability to exploit that gap has been an integral part of their competitive advantage. Some companies are committed to maintain lower selling price to attract more customers, even if maintaining lower cost price is not easy. We should remember that...
The curious case of slow/fast grequests code - PyCon SG 2019
มุมมอง 7615 ปีที่แล้ว
Speaker: Saurabh Hirani, Principal Devops Engineer If you have made a single HTTP request in Python, you have probably used the requests module. If you have made concurrent HTTP requests in Python, you have probably used the grequests module. I ran into an issue in production which made a grequests based code execute HTTPS GET requests serially without utilising the concurrency goodness promise...
Digital process automation (RPA) using TagUI for Python - PyCon SG 2019
มุมมอง 22K5 ปีที่แล้ว
Speaker: Ken Soh, RPA Specialist TagUI for Python is a Python package for digital process automation (commonly known as RPA). Its simple, expressive and powerful API makes digital process automation fun and easy. Enjoy features such as website automation, visual automation, OCR automation, keyboard and mouse automation in one seamless API. More on this package on its GitHub page - github.com/te...
Demystifying RPA with Python - PyCon SG 2019
มุมมอง 8K5 ปีที่แล้ว
Speaker: Thu Ya Kyaw, Developer evangelist I will talk about what is RPA, how it is being used in the industry, what are the benefits, and how Python can be used to do amazing RPA projects and it's free. About the speaker: I learned python back in polytechnic days. It was mainly for things like web scraping back then. Nowadays, everything can be written in Python; artificial intelligence, machi...
Faster Python apps with open source APM - PyCon SG 2019
มุมมอง 8525 ปีที่แล้ว
Speaker: Aravind Putrevu, Developer Advocate Slow applications are no fun. Application performance monitoring (APM) makes tracking down issues problems much easier. But which tools should you use? With the release of Elastic APM, there’s a new option. Language server and Python client is fully open source so you can get started with any app. Elastic’s APM was released sometime ago, so it’s a ve...
Building an analytics data pipeline using Airflow and PySpark - PyCon SG 2019
มุมมอง 12K5 ปีที่แล้ว
Speaker: Yohei Onishi, Data Engineer I have been working on building analytics data pipeline for logistics process in retail industry using Airflow and Spark. I have used Python to author the data pipeline. In this session I will talk about real world use case of airflow including overview of Airflow, how to create your own Airflow cluster, how to integrate Airflow with Spark and how to reduce ...
Automate the Boring Stuff with Slackbot - PyCon SG 2019
มุมมอง 2.7K5 ปีที่แล้ว
Speaker: Takanori Suzuki Vice Chair of PyCon JP Committee, Python Boot Camp Today, there are many tasks to repeat in the company/community. In addition, we often use chat such as Slack for daily communication. So, I created a chatbot(PyCon JP Bot: github.com/pyconjp/pyconjpbot) to automate various boring tasks related to holding PyCon JP. In this talk, I will first explain how to create a chatb...
Graylog : Centralized logging of Application Logs - PyCon SG 2019
มุมมอง 1.4K5 ปีที่แล้ว
Speaker: Pratibha Jagnere, Senior Python Developer This talk aims to help developer and sysadmins who want to learn about centralized log management solution. By the end of the talk, Attendees will learn how to use Graylog to visualize application logs, as well as guidance on how to write their own log data extractor for unstructured logs. About the speaker: Pratibha is a Senior Python develope...
An introduction to Python for Machine Learning with VS Code and Azure - PyCon SG 2019
มุมมอง 6K5 ปีที่แล้ว
An introduction to Python for Machine Learning with VS Code and Azure - PyCon SG 2019
Ending Keynote - PyCon SG 2019
มุมมอง 685 ปีที่แล้ว
Ending Keynote - PyCon SG 2019
Demystifying Time Series Forecasting using Python - PyCon SG 2019
มุมมอง 2.2K5 ปีที่แล้ว
Demystifying Time Series Forecasting using Python - PyCon SG 2019
Machine Learning Model Development and Operation in DBS - PyCon SG 2019
มุมมอง 2615 ปีที่แล้ว
Machine Learning Model Development and Operation in DBS - PyCon SG 2019
2FA, WTF? - PyCon SG 2019
มุมมอง 395 ปีที่แล้ว
2FA, WTF? - PyCon SG 2019
When life gives you Orange, make data speak volumes! - PyCon SG 2019
มุมมอง 635 ปีที่แล้ว
When life gives you Orange, make data speak volumes! - PyCon SG 2019
How to train a wacky language model - PyCon SG 2019
มุมมอง 815 ปีที่แล้ว
How to train a wacky language model - PyCon SG 2019
Python on AWS Lambda - PyCon SG 2019
มุมมอง 2K5 ปีที่แล้ว
Python on AWS Lambda - PyCon SG 2019
Day 2 Opening Keynote - PyCon SG 2019
มุมมอง 365 ปีที่แล้ว
Day 2 Opening Keynote - PyCon SG 2019
Stream Processing Fundamentals with Apache Beam - PyCon SG 2019
มุมมอง 1K5 ปีที่แล้ว
Stream Processing Fundamentals with Apache Beam - PyCon SG 2019
Opening Keynote - PyCon SG 2019
มุมมอง 2395 ปีที่แล้ว
Opening Keynote - PyCon SG 2019
Learn Guitar Via Python Programming - PyCon APAC 2018
มุมมอง 1.6K6 ปีที่แล้ว
Learn Guitar Via Python Programming - PyCon APAC 2018
Streaming data processing pipelines with Apache Beam [in Python, naturally!] - PyCon APAC 2018
มุมมอง 27K6 ปีที่แล้ว
Streaming data processing pipelines with Apache Beam [in Python, naturally!] - PyCon APAC 2018
Applying serverless architecture pattern to distributed data processing - PyCon APAC 2018
มุมมอง 796 ปีที่แล้ว
Applying serverless architecture pattern to distributed data processing - PyCon APAC 2018
Game Programming with Python - PyCon APAC 2018
มุมมอง 3856 ปีที่แล้ว
Game Programming with Python - PyCon APAC 2018

ความคิดเห็น

  • @rubynguyen_68
    @rubynguyen_68 ปีที่แล้ว

    Old but gold. Thanks for sharing 🤩

  • @HikeSafely-xc2bs
    @HikeSafely-xc2bs ปีที่แล้ว

    Excellent book 👌

  • @sumanjoshiphysics
    @sumanjoshiphysics ปีที่แล้ว

    Good explanation sir

  • @5thbatman
    @5thbatman 2 ปีที่แล้ว

    this is gold...

  • @callsignoffice5652
    @callsignoffice5652 2 ปีที่แล้ว

    At 13:00 in "export>>transform" what does a ">>" operator means? Doesn't look like "bit shifting"...

  • @morenoh149
    @morenoh149 2 ปีที่แล้ว

    46:40 is money

  • @youssefsassi3711
    @youssefsassi3711 3 ปีที่แล้ว

    Amazing presentation, how can I run the application ?

  • @dddsde3039
    @dddsde3039 3 ปีที่แล้ว

    Some segments in the video are stamped not adjacent to each other

  • @ThuyLe-bs2hq
    @ThuyLe-bs2hq 3 ปีที่แล้ว

    Some segments in the video are stamped not adjacent to each other

  • @helminenjuha
    @helminenjuha 3 ปีที่แล้ว

    Great prez, thank you!

  • @adesojialu1051
    @adesojialu1051 3 ปีที่แล้ว

    Please I need your email address

  • @AmitITpartner
    @AmitITpartner 3 ปีที่แล้ว

    Great Presentation, I loved it.

  • @LamNguyen-ye4hr
    @LamNguyen-ye4hr 3 ปีที่แล้ว

    Some segments in the video are stamped not adjacent to each other

  • @RichaBehera129
    @RichaBehera129 3 ปีที่แล้ว

    Their English ascent is like this only.I must say very good and nice explanation of project flow. Can u please bring any video regarding the flow of Business Analyst how they storing the data on hive and the real time flow etc.

  • @nilanjandas2428
    @nilanjandas2428 3 ปีที่แล้ว

    Dude, you must work with your English speaking skill

    • @joggyjames
      @joggyjames 2 ปีที่แล้ว

      nonsense

    • @rjayanth
      @rjayanth ปีที่แล้ว

      The Content is Fantastic.. if you have problem with English use subtitles available. spend some more time to understand the content. His time is precious.

  • @NH2001BONJOVI
    @NH2001BONJOVI 3 ปีที่แล้ว

    Amazing presentation, probably the best video I've ever seen aboyt beam! Thank you very much!

  • @kalsepakkka
    @kalsepakkka 3 ปีที่แล้ว

    This is by far the best explanation of what Apache Beam is and how extensively it can be used to solve real world data processing problems! Kudos!

  • @arquitetodasgalaxias
    @arquitetodasgalaxias 3 ปีที่แล้ว

    Do we have the source on github? Fantastic explanation!

  • @slavko5666
    @slavko5666 3 ปีที่แล้ว

    There's bigger problems in this world. Sad to see wasted potential.

    • @himanshujindal5498
      @himanshujindal5498 3 ปีที่แล้ว

      one out of five children report being bullied- middle school peak- depression,anxiety- increasing exponentially-you are stupid

  • @_coniferous
    @_coniferous 3 ปีที่แล้ว

    That explanation of "spec" at ~21:50 didn't make sense to me

  • @oleksandershevchenko8063
    @oleksandershevchenko8063 3 ปีที่แล้ว

    Nice example of how to talk a lot and said nothing certain at the same time.

  • @Induraj11
    @Induraj11 3 ปีที่แล้ว

    best explanation..best of all

  • @liukaiyu683
    @liukaiyu683 3 ปีที่แล้ว

    Your repo is a GEM! I m going to use the TagUI for my capstone project!!

  • @ekram0082
    @ekram0082 3 ปีที่แล้ว

    Great Video. Is it possible to get the video of recording glitch(16-24 minutes)? I think it is important to understand how it works?

    • @kensoh
      @kensoh 3 ปีที่แล้ว

      Hi Ekram, nice to see you here! I have not visited this page for a long time and missed your message.

  • @lazarivic2165
    @lazarivic2165 3 ปีที่แล้ว

    using nano..........

  • @GG-uz8us
    @GG-uz8us 3 ปีที่แล้ว

    In terms of complex JSON schema, I definitely think Azure Databricks handles it a lot better than Apache Beam. And installing third party libraries, Databricks is way easier.

  • @Suzakukoi
    @Suzakukoi 4 ปีที่แล้ว

    I want to do a word embedding using GloVe with my own corpus. Is that possible?

  • @nasiksami2351
    @nasiksami2351 4 ปีที่แล้ว

    Can you please share the data and source code? I'm currently working on cyber-bullying data. It would be much helpful for me to get an idea of the problem.

  • @GG-uz8us
    @GG-uz8us 4 ปีที่แล้ว

    Can I have the code for the second demo?

  • @jonathanskaza386
    @jonathanskaza386 4 ปีที่แล้ว

    Great presentation. Where do you host your bots?

  • @gemyforson8710
    @gemyforson8710 4 ปีที่แล้ว

    Thanks a lot Thu Ya, this is really Excellent.

    • @iamthuya
      @iamthuya 3 ปีที่แล้ว

      Thanks for the kind words. Cheers!

  • @florianhonicke5448
    @florianhonicke5448 4 ปีที่แล้ว

    The explanation is great. Thanks a lot

  • @_jiwi2674
    @_jiwi2674 4 ปีที่แล้ว

    Thanks for the presentation, great insights. Please fix the mic though, it keeps cutting from time to time

  • @bcrant
    @bcrant 4 ปีที่แล้ว

    @Keith Rozario Just want to say that the Keith Richards joke was hilarious. Maybe not the right audience, but I got a big laugh out of it. Thanks for this

    • @keithrozario6434
      @keithrozario6434 4 ปีที่แล้ว

      Lol, nobody gets that joke whenever I tell it :( Thanks for noticing.

    • @bcrant
      @bcrant 4 ปีที่แล้ว

      @@keithrozario6434 Never stop, it's golden!

  • @cadenyu7067
    @cadenyu7067 4 ปีที่แล้ว

    most detailed video on beams i've watched so far. thank you very much.

  • @Oliviaheckel
    @Oliviaheckel 4 ปีที่แล้ว

    Realy Nice

    • @iamthuya
      @iamthuya 3 ปีที่แล้ว

      Thank you. I hope you gain something useful from talk.

  • @krshsuman
    @krshsuman 4 ปีที่แล้ว

    Hello Ken Shoh , first of all , this tool is really good . Can you please give me some expert advise , how to automate MS visio , diagrams as well as data with the help of TagUI

    • @kensoh
      @kensoh 3 ปีที่แล้ว

      Hi Suman, sorry I just saw this page after a long time. You'll have to use visual automation and likely also r.mouse(). A assuming that you are using Visio as a desktop app. Feel free to ask questions on RPA for Python GitHub page or the user community group chat on Telegram

  • @arjwego11
    @arjwego11 4 ปีที่แล้ว

    Great package! Does TagUI record the desktop application at user end? Or we have to know what we are recording for?

    • @kensoh
      @kensoh 3 ปีที่แล้ว

      Now there is no recording for desktop apps, but for TagUI, there is a plan for an AI Recorder hopefully by end of June??

  • @deepakarthikeyan3109
    @deepakarthikeyan3109 4 ปีที่แล้ว

    Informative video.thanks for sharing

  • @deepakarthikeyan3109
    @deepakarthikeyan3109 4 ปีที่แล้ว

    Good presentation.thanks for sharing

    • @iamthuya
      @iamthuya 3 ปีที่แล้ว

      Thanks for the support!

  • @rajasuresh29us
    @rajasuresh29us 4 ปีที่แล้ว

    Wonderfull spech thanks for your input

  • @jagmeetsarna7695
    @jagmeetsarna7695 4 ปีที่แล้ว

    Is physical data allowed to leave the environment? As in is it possible to copy or upload the data to a 3rd location outside the environment?

  • @rezahamzeh3736
    @rezahamzeh3736 4 ปีที่แล้ว

    Thx for the presentation. Can I find the source code somewhere?

    • @Taka-ft4cl
      @Taka-ft4cl 4 ปีที่แล้ว

      You can find the code in my GitHub repository. github.com/dstaka/kafka-spark-demo-pyconsg19/

  • @gionigo
    @gionigo 4 ปีที่แล้ว

    To spare you 40 mins, double monkey patching.

  • @lashoes2207
    @lashoes2207 4 ปีที่แล้ว

    And heeerrrr we gooooo (Very strong vibe of hydrolic press channel here :) )

  • @maxkrog7237
    @maxkrog7237 4 ปีที่แล้ว

    Love this presentation. Humorous & incredibly pedagogical. The live demo at the end is 10/10.

  • @ivanleong8658
    @ivanleong8658 4 ปีที่แล้ว

    Thanks Ken for developing this tool, really appreciate your work in this area!

  • @pradeeppadmanaban2689
    @pradeeppadmanaban2689 4 ปีที่แล้ว

    there is no sound from 3:25 time to 12:40 can you please fix it

  • @SunShiNnneEee
    @SunShiNnneEee 4 ปีที่แล้ว

    great speech !!!! this is helpful

    • @Taka-ft4cl
      @Taka-ft4cl 4 ปีที่แล้ว

      Thank you for your comment. I'm glad to hear that :)

  • @onewithsixonewithsix601
    @onewithsixonewithsix601 4 ปีที่แล้ว

    Thank you for uploading this and thanks to Takanori for amazing content

    • @Taka-ft4cl
      @Taka-ft4cl 4 ปีที่แล้ว

      Thank you for your comment. I'm happy to hear that !

    • @rezahamzeh3736
      @rezahamzeh3736 3 ปีที่แล้ว

      @@Taka-ft4cl Can you please share the codes?