Hi, thanks for the tips. Follow the steps shown in the video. However, in my case I need to write to an oracle on premises (external database). I created the jdbc connection (it works), I created the crawler pointing to S3(ok), I created the crawler pointing to oracle(ok). I created the Glue job reading from s3 and targeting oracle. However, when running the job, it generates the following error: Thread-5 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassNotFoundException: org.apache.logging.log4j.core.lookup.JndiLookup at java.net.URLClassLoader.findClass(URLClassLoader.java:382) Thread-5 INFO Log4j appears to be running in a Servlet environment, but there's no log4j-web module available. If you want better web container support, please add the log4j-web JAR to your web archive or server lib directory. how to enable log4j?
I am very new to aws and all this kind of stuff. Would I be able to store an image in an s3 bucket and then have some sort of reference of it in my mysql database? I have a question/answer system set up in the db, but I also need to add an image for each question and I've been trying to figure out the best way to do this. I'd appreciate any input about this.
Thanks a lot for this video, it's very helpful. The issue I have right now is that I want to run a job on a daily basis to a target Postgresql RDS instance, but the data is being appended to my target table. I want only the data added to my source table to be appended to my target table. In brief, I want to overwrite my target table. I have enabled the bookmark in my job, but it doesn't seem to work correctly. How would you achieve such goal?
This is informative and nice one too. Would like to give you few suggestions from this video. 1) You did not mention about role here "ETL" like what policies required etc., 2) Background music: Try to avoid music while explaining such educational videos 3) Try to prepare a small PPT with bullet points that what you are going to discussing here and topics.
Thanks for making this video. Can you please show how you created this Role 'ETL' for Glue so that Glue can read from S3 and load to RDS (MySQL). Kindly make a video on this. Also, I would request you to please lower the background music or remove it altogether.
Very well explained! Wish you'd come up with a complete example to populate the Redshift (real world situation like updates and deletes to the Redshift)
Hi brother send me your contact number
Love the music! Wish more tutorials had it
Can you brief me about what is the need of glue I’m new to data engineering .
Hi,
thanks for the tips.
Follow the steps shown in the video. However, in my case I need to write to an oracle on premises (external database). I created the jdbc connection (it works), I created the crawler pointing to S3(ok), I created the crawler pointing to oracle(ok).
I created the Glue job reading from s3 and targeting oracle. However, when running the job, it generates the following error:
Thread-5 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassNotFoundException: org.apache.logging.log4j.core.lookup.JndiLookup at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
Thread-5 INFO Log4j appears to be running in a Servlet environment, but there's no log4j-web module available. If you want better web container support, please add the log4j-web JAR to your web archive or server lib directory.
how to enable log4j?
Jim , I am viewing ur channel now to get some idea on glue
please remove the background music
I am very new to aws and all this kind of stuff. Would I be able to store an image in an s3 bucket and then have some sort of reference of it in my mysql database? I have a question/answer system set up in the db, but I also need to add an image for each question and I've been trying to figure out the best way to do this. I'd appreciate any input about this.
Thanks for this wonderful video. Does glue support delta feed? If so could you please explain how glue handles UPSERT for delta feed?
Very informative!! Thank you!!
@Fun With ETL can you please show how to create IAM role ETL.
What is the complete flow of the process? Where does the location "ORCL.JIMMACAULA…" comes from?
nice video but music is not needed for an educational video is my opinion.
Thanks a lot for this video, it's very helpful. The issue I have right now is that I want to run a job on a daily basis to a target Postgresql RDS instance, but the data is being appended to my target table. I want only the data added to my source table to be appended to my target table. In brief, I want to overwrite my target table. I have enabled the bookmark in my job, but it doesn't seem to work correctly. How would you achieve such goal?
you can do better
What are the policies you added to I am
Good explanation but the music is over powering. Can you please lower/remove the background music?
This is informative and nice one too. Would like to give you few suggestions from this video. 1) You did not mention about role here "ETL" like what policies required etc., 2) Background music: Try to avoid music while explaining such educational videos 3) Try to prepare a small PPT with bullet points that what you are going to discussing here and topics.
Thanks for making this video. Can you please show how you created this Role 'ETL' for Glue so that Glue can read from S3 and load to RDS (MySQL). Kindly make a video on this. Also, I would request you to please lower the background music or
remove it altogether.
Very well explained! Wish you'd come up with a complete example to populate the Redshift (real world situation like updates and deletes to the Redshift)
can you please point me to which transform i should use to add a row only if it doesn't exist in RDS table
Very informative. Please keep posting videos like this. Thanks for sharing !