Thank you glenn wolfe for pointing it out. Yes, your solution works fine too. I did face that problem. In production environment, create-react-app enables the service worker which gets cached in the cloudfront.

In order to get latest deployed files, we have either to disable service worker or invalidate it from CloudFront.

So later i develop a library https://www.npmjs.com/package/react-deploy-cli which does take care of it.