Thanks for sharing. Some comments for viewers: (1). The use of %(deptno) to concatenate text into the SELECT statement is a big security risk and can have poor scalability. Please, please, please use a bind variable instead. (2). I may have missed it, but any large data sizes will want to increase the oracledb arraysize setting to improve query result fetching performance (3). For a simple case when querying and writing to file without manipulating data in Python, I wouldn't use Pandas since this adds overhead of converting to a dataframe. Just use Python's csv module directly.
Thanks for sharing. Some comments for viewers: (1). The use of %(deptno) to concatenate text into the SELECT statement is a big security risk and can have poor scalability. Please, please, please use a bind variable instead. (2). I may have missed it, but any large data sizes will want to increase the oracledb arraysize setting to improve query result fetching performance (3). For a simple case when querying and writing to file without manipulating data in Python, I wouldn't use Pandas since this adds overhead of converting to a dataframe. Just use Python's csv module directly.
Thanks for your inputs. Appreciate it.
Plz create playlist for etl automation
Sure.