Skip to main content

Posts

National Enquirer and Jeff Bezos

If you haven't followed the recent drama of the National Enquirer and my dear ex-boss Jeff Bezos, here's a quick rundown. No thank you. Mr. Pecker The case is now part of the official definition of the word "Extortion"

Introducing Flixport, a tool that exports photos from Flickr

Overview If you are like me with tens of thousands photos in Flickr which is about to stop 1TB free storage service, moving these photos out would be a very challenging task. Flixport is an open source command line tool that bulk-copies photos from Flickr to Amazon S3, Google Storage or your local computer. Flickr is terminating the free 1TB storage service in February 2019. Unless you convert to a premium user, Flickr will only keep 1000 photos and purge others at some point in February. To backup my own photos I evaluated all existing solution and none worked for me. Luckily, being a software engineer, I could write code to work around difficulties. Please visit the Flixport page to find out more. Why S3 and Google storage? AWS S3, as of today, is the de facto online storage. People may hear Dropbox or Box more often but many of these consuming storage product are backed by another Cloud storage service, of which S3 is the clear leader. Since coding is not a problem ...

Tensorflow Hub web experience

Tensorflow released a more dynamic and discoverable web experience for Tensorflow Hub modules. Check it out . TensorFlow Hub is a platform for sharing reusable pieces of ML, and our vision is to provide a convenient way for researchers and developers to share their work with the broader community. Can't believe I haven't posted anything in last 3 years. Something either extremely bad or extremely good must have happened.

Private Maven repository in Amazon S3

To put together a private Maven repository, Amazon S3 might be the only solution that requires no installation of software. Comparing to hosting a nexus, S3 backend solution is incredibly cheap. In fact most cases don't exceed the free tier. Besides it comes with all benefits of S3 as storage: 11-9s durability, highly available, IAM based authentication, easy to integrate with CDN, etc. Unfortunately Maven doesn't come with a native S3 wagon. This blog talks about how to setup private Maven repository on S3 using CyclopsGroup open source utilities. Define repositories in base pom This following example defines a SNAPSHOT repository for a project to pull dependencies from, in bucket mycompany-bucket-name with prefix /maven/snapshot-repository. A release repository can be setup in a similar way.     <properties>
<aspectj.version>1.6.11</aspectj.version>
</properties>     ...     <dependency>
   ...

Another weekend project

It takes quite a lot of energy to finish watching the entire five seasons of Breaking Bad. To finish it strong, this weekend I decided to try something that I haven't done for almost 18 years.

Gitcon, runtime configuration via a Git repo

This weekend, aside from taking kid to football game and various classes, changing diapers and watching "Breaking bad", I've been working on an new small open source library, Gitcon , which allows Java application to decouple some configuration into a standalone source repository so that software owner can modify configuration without deploying application for every modification. It is a cheap approach to dynamic configuration. By the way, I was very surprise to find out that the term "Gitcon" has not been reserved for "Git conference" so far. Requirements What led me to this project was a set of requirements: As a start, the configuration means properties file As a start, only Git source repository needs to be supported As a start, it only needs to gets configuration for once when application starts. The configuration is used to populate Spring application context where beans are mostly singletons. Software owner needs to restart applica...

Picture worths a thousand words