Skip to content

Instantly share code, notes, and snippets.

@edwardchanjw
Last active January 23, 2018 13:08
Show Gist options
  • Save edwardchanjw/fa91eb219a3c8c2a226e3157409ec038 to your computer and use it in GitHub Desktop.
Save edwardchanjw/fa91eb219a3c8c2a226e3157409ec038 to your computer and use it in GitHub Desktop.
Development Guidelines
https://cryptoinsider.com/content/decentralizing-bandwidth-to-create-anti-ddos-and-cdn-ecosystems/index.html
Service Engineering: European Research Results
https://stackoverflow.com/questions/27865120/would-you-use-fluent-validation-with-database-calls
https://words.mxbry.com/how-i-used-google-drive-and-firebase-to-give-my-static-site-a-cms-7226e01a51b5
https://words.mxbry.com/how-i-used-google-drive-and-firebase-to-give-my-static-site-a-cms-7226e01a51b5
http://www.webhook.com/
https://www.pushtable.com
https://www.ticketmatic.com/docs/tickets/configure_ticket_sales/ticketlayout/example1/
https://qz.io/
https://stackoverflow.com/questions/30062264/is-it-a-good-idea-to-iterate-through-several-browsers-in-one-test-using-selenium
https://support.smartbear.com/testcomplete/docs/app-testing/web/general/cross-browser/running.html
https://developer.mozilla.org/en-US/docs/Learn/Tools_and_testing/Cross_browser_testing/Your_own_automation_environment
https://sqa.stackexchange.com/questions/25396/new-browser-window-every-new-iteration
wibr+ android
Fluxion
Api gateway
- logging password * encrypt
https://databricks.com/blog/2017/05/30/entropy-based-log-redaction-apache-spark-databricks.html
https://docs.axway.com/bundle/APIGateway_753_AdministratorGuide_allOS_en_HTML5/page/Content/AdminGuideTopics/admin_redactors.htm
https://docs.oracle.com/cd/E65459_01/admin.1112/e65449/content/admin_redactors.html
- function as a service
- express and spring cloud / spring cloud task/dataflow
- grpc(dual duplex) use protobuf as idl and message interchange format
https://improbable.io/games/blog/grpc-web-moving-past-restjson-towards-type-safe-web-apis
chrome proxy/ chromedriver dual mode(selenium front,chrome debug back)
https://github.com/paulirish/automated-chrome-profiling/issues/14
https://blogs.igalia.com/dpino/2015/11/22/Architecture-of-the-Web-Inspector/
https://docs.travis-ci.com/user/gui-and-headless-browsers/
https://zwischenzugs.com/2017/10/16/puppeteer-headless-chrome-in-a-container/
https://github.com/ibm/acme-freight?cm_sp=IBMCode-_-unlock-enterprise-data-using-apis-_-Get-the-Code
https://github.com/auth0-blog/loopback-starwars-api
Model from db, datasource, rest
https://strongloop.com/strongblog/loopback-facebook-api-user-authentication/
https://streamsets.com
https://www.reddit.com/r/programming/comments/5evkir/why_do_microservices_need_an_api_gateway/
##Flow
https://blog.bernd-ruecker.com/how-to-implement-long-running-flows-sagas-business-processes-or-similar-3c870a1b95a8
https://bitscoop.com/
https://hackernoon.com/automate-your-life-with-airtable-and-zapier-3cc2857618d3
https://github.com/alpinegizmo/geekier/wiki
https://www.bip.io/
https://www.cloudpipes.com/
https://www.elastic.io/plans/
StackStorm
https://github.com/Fr8org/Fr8Core/blob/master/Docs/Home.md
http://www.cloudslang.io/#/
https://skyvia.com/data-integration/
https://flowxo.com/services
https://readme.io/
https://codeontime.com/
http://siddharathadhumale.blogspot.sg/2017/06/calling-rest-api-example-using-outsystem.html
https://zappysys.com/products/ssis-powerpack/ssis-xml-integration-pack/
https://www.stitchdata.com/pricing/
wso2
3scale
https://www.liip.ch/en/blog/overview-open-source-api-gateways
https://www.digitalocean.com/community/tutorials/how-to-manage-multi-node-deployments-with-rancher-and-docker-machine-on-ubuntu-16-04
https://spring.io/blog/2017/02/23/spring-framework-5-0-m5-update
https://stackoverflow.com/questions/39889052/why-use-server-sent-events-instead-of-simple-http-chunked-streaming
https://gist.github.com/CMCDragonkai/6bfade6431e9ffb7fe88
Bot mitigation distilnetworks and dqualshield
http://sangaline.com/post/advanced-web-scraping-tutorial/
http://scraping.pro/recaptcha-solve-selenium-python/
https://news.ycombinator.com/item?id=13884357
https://www.scrapehero.com/how-to-prevent-getting-blacklisted-while-scraping/
http://edmundmartin.com/web-scraping-avoiding-detection/
https://scrapinghub.com/crawlera
https://medium.com/@iamncla/taking-a-look-at-steamanalysts-anti-scraping-methods-d258c4162fe8
https://forum.uipath.com/t/captcha-automation/5519
https://github.com/colmena/colmena
https://community.tyk.io/t/does-tyk-allow-adding-a-nodejs-code-to-middleware-javascript/614
https://github.com/strongloop/microgateway
https://www.getambassador.io/
https://developer.ibm.com/apiconnect/whats-new/
http://blog.javaforge.net/post/32188367580/database-driven-message-source-in-spring
##BPM
camunda activiti bpmn2
drools
spring integration
camel
fabric9 funktion
apache airflow, spotify luigi
https://audiosex.pro/threads/groove-3-free-one-month-membership-no-strings-attached.22739/
https://www.howtogeek.com/138500/the-ultimate-guide-to-installing-incompatible-android-apps-from-google-play/
https://www.testcraft.io/product/
https://hackernoon.com/how-i-made-a-talking-emoji-using-regular-emojis-and-javascript-fe20e62ba10
https://www.reddit.com/r/ObtainFreeBitcoin/comments/79jgyg/best_faucets_list/
http://opendatatoolkit.worldbank.org/en/essentials.html
http://www.hydra-cg.com/
http://www.apelon.com/solutions/terminology-tooling/dts
http://www.popoloproject.com/
http://vocab.cc/v/tcd
https://api-platform.com/docs/core/extending-jsonld-context/
https://blog.codeship.com/json-ld-building-meaningful-data-apis/
https://www.distilled.net/resources/understanding-and-implementing-json-ld/
https://blogs.sap.com/2016/01/08/google-knowledge-graph-search-api-schemaorg-and-json-ld/
http://restdesc.org/about/descriptions
https://www.manifold.co/
https://getmesh.io/
https://containerum.com/
https://reactstudio.com/
http://forums.hardwarezone.com.sg/money-mind-210/anyone-here-buy-bitcoin-do-not-advertise-post-referrals-emails-4717308-52.html
https://docs.hasura.io/0.15/manual/custom-microservices/index.html
http://www.sczyh30.com/vertx-blueprint-microservice/api-gateway.html
https://www.codeday.top/2017/06/20/31020.html
https://github.com/Kamshak/firebase-steam-login
https://www.lunchbadger.com/how-to-implement-oauth-in-express-gateway/
http://www.tothenew.com/blog/getting-started-with-application-authentication-via-kong-api-gateway/
https://yos.io/2016/01/28/building-an-api-gateway-with-lua-and-nginx/
https://dzone.com/articles/advanced-microservices-security-with-spring-and-oa
https://dzone.com/articles/microservices-communication-zuul-api-gateway-1
https://dzone.com/articles/api-gateway-pattern-angular-js
https://piotrminkowski.wordpress.com/2017/02/22/microservices-security-with-oauth2/
https://howtodoinjava.com/spring/spring-cloud/spring-cloud-api-gateway-zuul/
https://medium.com/@nicklee1/using-api-gateways-and-jwts-for-identity-management-in-microservice-based-apis-9ba275864cef
https://spring.io/blog/2015/01/28/the-api-gateway-pattern-angular-js-and-spring-security-part-iv
https://medium.com/haiku-blog/lottie-without-after-effects-9c5a8e74c239
https://nickjanetakis.com/blog/using-wsl-and-mobaxterm-to-create-a-linux-dev-environment-on-windows
##UI
Webix data sync, kendo ui data, bonitasoft variables (data bind)
##Server Development Basic
##
http://www.popoloproject.com/
Advance: (Mitigate by Logging?)
- Record Full Transactions (Keeping all relevant info, or tracking via audit) For example, Steam User buying Skyrim on 2014, purchase record are stored as Skyrim instead of Skyrim Special, even the user are giving free update to Skyrim Special
-
##Customization
https://help.xmatters.com/OnDemand/xmodwelcome/communicationplanbuilder/designexample4_email_images.htm
https://pfrazee.github.io/blog/nodevms-alpha
##Bundle Mode
Is it data model wasting time for following configuration, functional/simple flow of function
of simple structure for rules system to verifying following is better?
- Packages with multiple product
- Packages should include product type of Game, video,
- Product could be grouping based on franchise, type, genre, limitation of age
- Customer limitation to buy certain type, group, limitation
- Customer limitation to membershp premium, country region
- Product could be purchase maximum how many order, amount of credit, payment method, or promotion period
Hirarchy data model good for
Package > Product :vs: promotion Period, how many order limit, etc
Tricky but still able to detect which steam game already own in package
##Enterprise Configuration
- Some Item must allowed to all customer, selected customer ([1, 2, 4]), or one customer [1], or no customer? What best stucture to manage in data store
ENV -- node-config
https://www.elastic.co/guide/en/apm/agent/nodejs/current/advanced-setup.html
https://github.com/trentm/node-bunyan/issues/116
Spring
https://doanduyhai.wordpress.com/2011/11/20/spring-transactional-explained/
http://www.logicbig.com/tutorials/spring-framework/spring-data-access-with-jdbc/transactional-annotation/
https://www.workfusion.com/rpaexpress#element-49ce91f3fe1e34f
PGS Portable Gaming System
ZTE Axon M
https://mspoweruser.com/microsoft-store-kicks-off-countdown-2018-sale/
http://forum.gpd.hk/t190-gpd-win-a-handheld-game-console-that-can-run-aaa-games-smoothly
https://sidbala.com/simple-cluster-nodejs-beanstalkd/
https://thomashunter.name/presentations/node-consul-v1/#/16
https://www.manning.com/books/the-tao-of-microservices
https://github.com/stdlib/lib
https://github.com/silverbucket/webfinger.js/
https://github.com/DataFire/integrations
https://mimik.com/
https://golem.network/
https://containership.io/pricing
https://blocknet.co/
https://github.com/geut/pell
https://www.predix.io/
https://market.yaas.io/beta
https://docs.strongloop.com/display/SLC/Managing+multi-server+apps
https://blog.cloudflare.com/service-discovery/
https://docs.openshift.com/online/dev_guide/port_forwarding.html
heroku not support tcp, socketio as fallback? linux skill as backup
https://devcenter.heroku.com/articles/exec
https://medium.com/@nadayar/heroku-fu-multiple-servers-on-one-dyno-6fc68d57b373
http://tomvn.com/posts/tcp-sockets-for-heroku.html
https://github.com/agnat/node_mdns/issues/155
ssdp
https://github.com/beakerbrowser/beaker/wiki/PSA-Web-Service-Discovery-Protocol
http://vertx.io/docs/vertx-service-discovery/java/
https://jkutner.github.io/2015/03/11/minecraft-on-heroku.html
https://help.dyn.com/bonjour-and-dns-discovery/
https://www.consul.io/docs/guides/datacenters.html
https://devcenter.heroku.com/articles/dyno-dns-service-discovery
https://blog.heroku.com/using_netflix_zuul_to_proxy_your_microservices
flynn
serf vs fabric8
https://www.terraform.io/docs/providers/index.html
https://recast.ai/pricing
https://apiary.io/plans
https://stackoverflow.com/questions/23319963/find-heroku-custom-domains-using-node-js
https://stackoverflow.com/questions/20553554/node-js-return-hostname
https://backendless.com/platform/marketplace/
https://git.market/
https://algorithmia.com/
https://unitcluster.com/
https://serviceprototypinglab.github.io/function-marketplace/#/registry
https://blog.containership.io/new-in-marketplace-ironfunctions-functions-as-a-service-in-11-clouds
mashape
https://askmacgyver.com/
https://spotinst.com/products/spotinst-functions/
https://pivotal.io/platform/pivotal-function-service
https://rapidapi.com/package/AmazonLambda
https://restoreprivacy.com/vpn-scams/
https://flippa.com/3043455-streamza-com
https://flippa.com/9346445-shopkins-games-com
https://flippa.com/9363882-kim-it-up
https://www.steamgifts.com/discussion/I6I4Z/christmas-event-updated
https://www.steamgifts.com/discussion/RXPyh/a-merry-steamgifts-christmas
https://www.steamgifts.com/discussion/pbCQR/steam-wallet-card-10-for-65-35-cheaper
https://paxful.com/offer/G2YV12JV15K
https://coderwall.com/p/9ub-6a/using-multiple-accounts-with-git-or-github
https://confluence.atlassian.com/bitbucket/set-up-additional-ssh-keys-271943168.html
https://medium.com/@fredrikanderzon/setting-up-ssh-keys-for-multiple-bitbucket-github-accounts-a5244c28c0ac
https://tiffanybbrown.com/2017/06/using-multiple-ssh-keys-with-github/index.html
https://coderwall.com/p/7smjkq/multiple-ssh-keys-for-different-accounts-on-github-or-gitlab
Spring Boot Session custom data / locale , Annotation SessionAttributes
Reading JSCH stricthostkey, i guess for security is to manually add key or verify it through third party
https://gzapps.com/ssh-host-key-validation-with-jsch-library.html
https://stackoverflow.com/questions/43646043/jsch-how-to-let-user-confirm-host-fingerprint
https://www.javatips.net/api/com.jcraft.jsch.jschexception
https://stackoverflow.com/questions/12838767/use-jsch-to-put-a-file-to-the-remote-directory-and-if-the-directory-does-not-exi
http://stackoverflow.link/question/2003419/com-jcraft-jsch-jschexception-unknownhostkey
https://stackoverflow.com/questions/43646043/jsch-how-to-let-user-confirm-host-fingerprint
http://www.svlada.com/ssh-public-key-authentication/#generate-key-pair
http://www.jscape.com/blog/setting-up-sftp-public-key-authentication-command-line
} catch (JSchException e1) {
e1.printStackTrace();
HostKey h = session.getHostKey();
String k = "172.18.8.36" + " ssh-rsa " + h.getKey() ;
https://medium.com/@steida/game-changer-algebraic-types-78b1dcca61a7
##External Service for extensiveale
https://github.com/strongloop/loopback/issues/2872
So in OSB you do (example synchronous sequence flow)
request stage
-- get message header from data object message and dynamic context (depends on transport protocol for instance) and construct ENTRY auditlog - pass to queue
-- process request (validate it, transform, do external service callout, etc.)
response stage
-- construct response data object message, do additional processing if required
-- get input message header from request data object message (available in the global pipeline context or stored in global variable) and enhance it with dynamic outbound context (depends again on transport protocol for intance) and construct EXIT auditlog -> pass to queu
-- reply data object message back to client (REST/SOAP) or pass to reply queue if asynchronous pattern in place
ADD: In case of any failure occured in error tracker you submit ERROR audit log message
So this is one of best case I implemented on multiple projects on OSB 10g,11g and 12c, now how I see the loopback possibility:
There could be some framework within loopback implemented (need to be generic), so I generate REST API from Postgres from schema (as I usually do) and I can enhance the generator with Audit functionality described above. I am really not sure if you consider such kind of auditing capabilities or not in the moment at IBM.
2. Maybe microgateway could be the answer
Microgateway is actually having probably some capability to do audittrail because(how I see it):
it implements from description "middleware context" and this is something I refer to as inbound/outbound context from available in OSB - I am personally missing here inbound and outbound context different, there is simply just one context, so I am not yet 100% sure how generic and robust is such context.
it can transform data from JSON, XML - so i assume it could be capable of extract from the request the AuditHeader part and pass it into the message queue/topic for all instances like ENTRY, EXIT, ERROR as I am looking for.
Data Domain
- Simple Rule system/User defined rule for business conveniently allowed by id, type, user defined group for allow (selected group allow to use coupon code, selected group enjoy premium discount, selected group pay more for fee)
- Type system more effective in rule system for example apply discount coupon for (membership class, payment, only premium member and mastercard pay, and limit by more than $100 for transaction), via gui or api
- System integration dream, would you able to generate coupon then force the system to use (membership class, payment card, and total payable)
- Before checkout api, as middleware/plugin manner for all e-commerce cms (validated period, loading the coupon and verify all the above is still feasible, could easily to support more rule?)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment